00000001:02000400:3.0F:1788535676.058381:0:2966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_hostid 00000001:02000400:3.0:1788535694.597371:0:3186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1788535696.080643:0:3248:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 771 MB/s 00000001:01000000:1.0:1788535696.330466:0:3248:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 839 MB/s 00000001:01000000:1.0:1788535696.579967:0:3248:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7779 MB/s 00000020:02000000:0.0F:1788535697.173098:0:3277:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_3_gb2d482c 00000400:02000000:0.0:1788535697.907442:0:3292:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.112@tcp [8/256/0/180] 00008000:02000000:3.0:1788535701.574175:0:3442:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0F:1788535751.142386:0:5243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788535760.691202:0:5814:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788535760.691208:0:5814:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788535760.691317:0:5814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000bb968a9 00000080:02000400:2.0:1788535760.691329:0:5814:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788535760.697270:0:5814:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788535760.697283:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788535760.697319:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002eea857c) 00000020:00000080:2.0:1788535760.697339:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788535760.709752:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788535760.710786:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788535760.745226:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788535760.745261:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788535760.745280:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788535760.745326:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788535760.745349:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788535760.745648:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788535760.745655:0:5814:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788535760.745665:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d364c 00000020:01000004:2.0:1788535760.749025:0:5814:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788535760.749036:0:5814:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788535760.749114:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000bb968a9 from MGS 00000020:01000004:3.0:1788535760.749120:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788535760.749158:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000003f7c2217) 00000020:00000080:3.0:1788535760.749177:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788535760.749299:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000bb968a9 from MGS, refs=2 00080000:01000000:3.0:1788535760.749306:0:5814:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788535760.749313:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d365a 00000100:00100000:3.0:1788535760.749453:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788535760.749598:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788535760.749604:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788535760.753439:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788535760.753455:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788535760.763424:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788535760.763616:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788535760.763623:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788535760.771119:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788535760.771133:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788535760.774712:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788535760.774727:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788535760.779456:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535760.779463:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535760.779465:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535760.792173:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535760.792180:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535760.792182:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535760.792808:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788535760.800034:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788535761.042483:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2407 MB/s 00000001:01000000:2.0:1788535761.292725:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2903 MB/s 00000001:01000000:2.0:1788535761.542005:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 479 MB/s 00000001:01000000:3.0:1788535761.796365:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 586 MB/s 00080000:10000000:2.0:1788535761.806275:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1788535761.807112:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788535761.844176:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788535761.844208:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788535761.844211:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788535761.847174:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788535761.847601:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788535761.847673:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788535761.847944:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788535761.847975:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788535761.848294:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788535761.848457:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788535761.848470:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788535761.854835:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788535761.854849:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788535761.855487:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788535761.855494:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788535761.858878:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788535761.858923:0:5814:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.112@tcp' 00000020:01000004:3.0:1788535761.858925:0:5814:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788535761.859039:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.112@tcp (typ=mgc) 00000020:00000080:3.0:1788535761.859051:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.112@tcp (0000000039b28e12) 00000020:00000080:3.0:1788535761.859067:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788535761.859154:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fca0c9e5@MGC192.168.203.112@tcp: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788535761.859324:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.112@tcp-0 is initialized 00000040:01000000:3.0:1788535761.859331:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788535761.861090:0:5829:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788535761.864087:0:5830:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788535761.864137:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.112@tcp (uuid ea5d41c9-12b3-443f-877d-8b3d703772fc) 00000020:00000080:3.0:1788535761.864161:0:5814:0:(genops.c:1385:class_connect()) connect: client ea5d41c9-12b3-443f-877d-8b3d703772fc, cookie 0x74f51638375d3668 00000100:00080000:3.0:1788535761.864173:0:5814:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788535761.864179:0:5814:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import 00000000fca0c9e5 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788535761.864235:0:5814:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000064dd4055 x1875415607017600/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788535761.864258:0:5814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ea5d41c9-12b3-443f-877d-8b3d703772fc->MGS 00000020:01000004:3.0:1788535761.864276:0:5814:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788535761.864282:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788535761.864296:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000fe7b6b41) 00000020:00000080:3.0:1788535761.864312:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788535761.866341:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064dd4055 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea5d41c9-12b3-443f-877d-8b3d703772fc:3307:1875415607017600:0@lo:250: 00000100:00100000:0.0:1788535761.866401:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535761.871153:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607017600 00000100:00100000:0.0:1788535761.871168:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607017600 00000100:00100000:0.0:1788535761.871223:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788535761.871229:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000018b837d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3307:x1875415607017600:12345-0@lo:250: 00010000:00080000:0.0:1788535761.871256:0:5826:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ea5d41c9-12b3-443f-877d-8b3d703772fc@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:0.0:1788535761.871286:0:5826:0:(genops.c:1385:class_connect()) connect: client ea5d41c9-12b3-443f-877d-8b3d703772fc, cookie 0x74f51638375d3676 00000100:00080000:0.0:1788535761.871425:0:5826:0:(import.c:65:import_set_state_nolock()) 000000006e4dcf2b : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788535761.871480:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000018b837d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:3307:x1875415607017600:12345-0@lo:250: Request processed in 249us (5078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535761.871488:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788535761.871535:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788535761.871544:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:0.0:1788535761.871550:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788535761.871555:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788535761.871558:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000fca0c9e5 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788535761.871560:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788535761.871567:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788535761.871572:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064dd4055 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea5d41c9-12b3-443f-877d-8b3d703772fc:3307:1875415607017600:0@lo:250: 00000100:00100000:3.0:1788535761.886627:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788535761.889475:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788535761.889487:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788535761.899209:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788535761.899223:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788535761.899685:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788535761.899692:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788535761.900450:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788535761.900632:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788535761.900637:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788535761.902525:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788535761.902536:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788535761.982217:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788535761.982450:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788535761.982457:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788535761.992475:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788535761.992494:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788535761.995438:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788535761.996085:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788535761.996093:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788535761.997228:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788535761.997238:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788535762.005655:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788535762.005921:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788535762.005930:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788535762.007180:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788535762.007190:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788535762.007809:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788535762.008027:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788535762.008032:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788535762.008826:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788535762.008834:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788535762.082884:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788535762.083111:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788535762.083118:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788535762.086403:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788535762.086417:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788535762.090869:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788535762.090880:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788535762.100056:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788535762.100079:0:5814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788535762.100086:0:5814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788535762.100219:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788535762.100253:0:5814:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788535762.100258:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788535762.100260:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788535762.100261:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788535762.100262:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788535762.100264:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788535762.100265:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788535762.100267:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788535762.100268:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788535762.100270:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788535762.100271:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788535762.100272:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788535762.100274:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788535762.100276:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788535762.100278:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788535762.100279:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788535762.100280:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788535762.100281:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788535762.100286:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788535762.100287:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788535762.100288:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788535762.100289:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788535762.100290:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788535762.100291:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788535762.100292:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788535762.100293:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788535762.100324:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788535762.100341:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8b734ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607017728:0@lo:253: 00000100:00100000:0.0:1788535762.100415:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535762.100475:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e27d5c2e going to sleep for 11 seconds 00000100:00100000:1.0:1788535762.100924:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607017728 00000100:00100000:1.0:1788535762.100932:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607017728 00000100:00100000:1.0:1788535762.100976:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788535762.100984:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000919b7523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:5814:x1875415607017728:12345-0@lo:253: 20000000:01000000:1.0:1788535762.101024:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788535762.101027:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788535762.101642:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788535762.101712:0:5827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788535762.102032:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788535762.105028:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788535762.105253:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788535762.105257:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788535762.105265:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788535762.105267:0:5827:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788535762.105283:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788535762.105492:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788535762.105729:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788535762.105741:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788535762.105785:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788535762.105834:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788535762.105872:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788535762.105999:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788535762.106009:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788535762.106053:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788535762.106061:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788535762.106091:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788535762.106098:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788535762.106129:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788535762.106175:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788535762.106203:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788535762.106208:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788535762.106220:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788535762.106405:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788535762.106415:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788535762.106448:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788535762.106481:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788535762.106526:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788535762.106537:0:5827:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788535762.106605:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788535762.106621:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788535762.106683:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788535762.106720:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788535762.106753:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788535762.106763:0:5827:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788535762.106842:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788535762.106852:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788535762.106883:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788535762.106945:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788535762.107112:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788535762.107160:0:5827:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788535762.107168:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788535762.114021:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788535762.114393:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788535762.114420:0:5827:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.112@tcp for mdt 20000000:01000000:2.0:1788535762.114423:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:2.0:1788535762.114457:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788535762.114464:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788535762.114492:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788535762.114499:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:2.0:1788535762.114541:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788535762.114550:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788535762.114581:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788535762.114614:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788535762.114683:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788535762.114686:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788535762.114691:0:5827:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788535762.114697:0:5827:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788535762.115428:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1788535762.115535:0:5827:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788535762.124619:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788535762.124686:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788535762.124813:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788535762.124832:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788535762.124847:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788535762.124851:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788535762.124863:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788535762.124865:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788535762.125034:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788535762.125037:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788535762.125554:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788535762.125821:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788535762.125861:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788535762.126117:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788535762.126144:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788535762.126146:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788535762.126503:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1788535762.126683:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1788535762.126720:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1788535762.126777:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1788535762.126792:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788535762.126794:0:5827:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1788535762.126801:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788535762.126819:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006400039d/0x74f51638375d367d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.126834:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006400039d/0x74f51638375d367d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.126844:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006400039d/0x74f51638375d367d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.126849:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006400039d/0x74f51638375d367d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.126855:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006400039d/0x74f51638375d367d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.126860:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006400039d/0x74f51638375d367d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.126866:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006400039d already unused, calling callback (00000000084dceb9) 00010000:00010000:1.0:1788535762.126869:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006400039d/0x74f51638375d367d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.126882:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006400039d/0x74f51638375d367d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.126926:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006400039d/0x74f51638375d367d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.126934:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006400039d/0x74f51638375d367d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.126939:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006400039d/0x74f51638375d367d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788535762.126956:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788535762.443411:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000919b7523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:5814:x1875415607017728:12345-0@lo:253: Request processed in 342421us (342989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535762.443426:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788535762.443599:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8b734ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607017728:0@lo:253: 10000000:01000000:0.0:1788535762.443615:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788535762.443618:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788535762.443620:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788535762.443621:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788535762.443622:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788535762.443623:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788535762.443625:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788535762.443626:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788535762.443627:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788535762.443629:0:5814:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788535762.443631:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788535762.443632:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788535762.443653:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000bb968a9 from lustre-MDT0000 10000000:01000000:0.0:1788535762.443689:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788535762.443692:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788535762.443697:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97a986be19c0 10000000:01000000:0.0:1788535762.443702:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788535762.443720:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97a986be19c0 from 1 10000000:01000000:0.0:1788535762.443723:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788535762.443768:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000805bbd64/0x74f51638375d3684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535762.443778:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000805bbd64/0x74f51638375d3684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535762.443787:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000805bbd64/0x74f51638375d3684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535762.443804:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8b734ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607017856:0@lo:101: 00000100:00100000:0.0:1788535762.443837:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535762.443955:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017ac6d76 going to sleep for 11 seconds 00000100:00100000:3.0:1788535762.444014:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607017856 00000100:00100000:3.0:1788535762.444022:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607017856 00000100:00100000:3.0:1788535762.444067:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788535762.444083:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c171d4d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:5814:x1875415607017856:12345-0@lo:101: 00010000:00010000:3.0:1788535762.444095:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535762.444108:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000059a3eda0/0x74f51638375d368b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3684 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535762.444141:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000059a3eda0/0x74f51638375d368b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3684 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535762.444150:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000059a3eda0/0x74f51638375d368b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3684 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535762.444158:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000059a3eda0, rc 0) 00000100:00100000:3.0:1788535762.444223:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c171d4d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+6:5814:x1875415607017856:12345-0@lo:101: Request processed in 141us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535762.444229:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788535762.444469:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8b734ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607017856:0@lo:101: 00010000:00010000:1.0:1788535762.444481:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000805bbd64/0x74f51638375d3684 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d368b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.444490:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000805bbd64/0x74f51638375d3684 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d368b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535762.444555:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fd8bbe2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607017984:0@lo:501: 00000100:00100000:1.0:1788535762.444589:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535762.444642:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607017984 00000100:00100000:0.0:1788535762.444646:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607017984 00000100:00100000:0.0:1788535762.444679:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788535762.444685:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4aac381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+6:5814:x1875415607017984:12345-0@lo:501: 00000100:00100000:0.0:1788535762.444920:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4aac381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+6:5814:x1875415607017984:12345-0@lo:501: Request processed in 201us (297us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788535762.444928:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788535762.449451:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000030b12de8 going to sleep for 11 seconds 00000100:00100000:2.0:1788535762.449510:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fd8bbe2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607017984:0@lo:501: 10000000:01000000:2.0:1788535762.449554:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788535762.449570:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000805bbd64/0x74f51638375d3684 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d368b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535762.449580:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000805bbd64/0x74f51638375d3684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d368b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535762.449590:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a9ac46a000 10000000:01000000:2.0:1788535762.449598:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788535762.449602:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97a9ac46a000 10000000:01000000:2.0:1788535762.449605:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788535762.449607:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97a9ac46a000 from 1 10000000:01000000:2.0:1788535762.449610:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788535762.449680:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000507144d0/0x74f51638375d3692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535762.449688:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000507144d0/0x74f51638375d3692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535762.449698:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000507144d0/0x74f51638375d3692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535762.449717:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008be69c26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607018112:0@lo:101: 00000100:00100000:2.0:1788535762.449798:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535762.449842:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b7a5ba22 going to sleep for 11 seconds 00000100:00100000:1.0:1788535762.449962:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607018112 00000100:00100000:1.0:1788535762.449969:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607018112 00000100:00100000:1.0:1788535762.450020:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788535762.450038:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfd9fac5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+6:5814:x1875415607018112:12345-0@lo:101: 00010000:00010000:1.0:1788535762.450051:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535762.450064:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006400039d/0x74f51638375d3699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3692 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.450084:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006400039d/0x74f51638375d3699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3692 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.450093:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006400039d/0x74f51638375d3699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3692 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535762.450100:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006400039d, rc 0) 00000100:00100000:1.0:1788535762.450150:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfd9fac5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+7:5814:x1875415607018112:12345-0@lo:101: Request processed in 114us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535762.450157:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788535762.450338:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008be69c26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607018112:0@lo:101: 00010000:00010000:0.0:1788535762.450350:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000507144d0/0x74f51638375d3692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535762.450359:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000507144d0/0x74f51638375d3692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535762.450372:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788535762.450388:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000507144d0/0x74f51638375d3692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535762.450394:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000507144d0/0x74f51638375d3692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535762.450400:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788535762.450413:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788535762.450418:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97a9ac46a000 10000000:01000000:0.0:1788535762.450420:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788535762.450424:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788535762.450425:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788535762.450441:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 0000000029190b3c/0x74f51638375d36a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535762.450447:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 0000000029190b3c/0x74f51638375d36a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535762.450453:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 0000000029190b3c/0x74f51638375d36a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535762.450465:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa695970 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607018240:0@lo:101: 00000100:00100000:0.0:1788535762.450495:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535762.450513:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba869401 going to sleep for 11 seconds 00000100:00100000:2.0:1788535762.450638:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607018240 00000100:00100000:2.0:1788535762.450643:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607018240 00000100:00100000:2.0:1788535762.450684:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788535762.450691:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003092b521 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+7:5814:x1875415607018240:12345-0@lo:101: 00010000:00010000:2.0:1788535762.450706:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535762.450714:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000671678c3/0x74f51638375d36a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d36a0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535762.450728:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000671678c3/0x74f51638375d36a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d36a0 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535762.450736:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000671678c3/0x74f51638375d36a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d36a0 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535762.450741:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000671678c3, rc 0) 00000100:00100000:2.0:1788535762.450767:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003092b521 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+8:5814:x1875415607018240:12345-0@lo:101: Request processed in 78us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535762.450773:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788535762.450858:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa695970 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607018240:0@lo:101: 00010000:00010000:0.0:1788535762.450868:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 0000000029190b3c/0x74f51638375d36a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d36a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535762.450874:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 0000000029190b3c/0x74f51638375d36a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d36a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535762.450949:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa695970 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607018368:0@lo:501: 00000100:00100000:0.0:1788535762.450975:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535762.451001:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba869401 going to sleep for 11 seconds 00000100:00100000:2.0:1788535762.451052:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607018368 00000100:00100000:2.0:1788535762.451056:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607018368 00000100:00100000:2.0:1788535762.451083:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788535762.451088:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000150ef4fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+8:5814:x1875415607018368:12345-0@lo:501: 00000100:00100000:2.0:1788535762.451537:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000150ef4fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+9:5814:x1875415607018368:12345-0@lo:501: Request processed in 448us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535762.451545:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788535762.451618:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa695970 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607018368:0@lo:501: 00000100:00100000:0.0:1788535762.451647:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa695970 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607018496:0@lo:503: 00000100:00100000:0.0:1788535762.451690:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535762.451712:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba869401 going to sleep for 11 seconds 00000100:00100000:2.0:1788535762.451810:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607018496 00000100:00100000:2.0:1788535762.451814:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607018496 00000100:00100000:2.0:1788535762.451845:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788535762.451851:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094c7c793 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+9:5814:x1875415607018496:12345-0@lo:503: 00000100:00100000:2.0:1788535762.452006:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094c7c793 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+9:5814:x1875415607018496:12345-0@lo:503: Request processed in 155us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535762.452012:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788535762.452140:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa695970 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607018496:0@lo:503: 00000100:00100000:1.0:1788535762.453570:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096303d0b pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:5855:1875415607018624:0@lo:502: 00000100:00100000:1.0:1788535762.453646:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535762.453734:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c18e4c4 going to sleep for 11 seconds 00000100:00100000:2.0:1788535762.454675:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607018624 00000100:00100000:2.0:1788535762.454687:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607018624 00000100:00100000:0.0:1788535762.454944:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788535762.454954:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fcac353 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+9:5855:x1875415607018624:12345-0@lo:502: 00000100:00100000:0.0:1788535762.455436:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fcac353 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+9:5855:x1875415607018624:12345-0@lo:502: Request processed in 482us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535762.455445:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788535762.455532:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096303d0b pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:5855:1875415607018624:0@lo:502: 00000020:01000000:1.0:1788535762.455563:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535762.455574:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535762.455577:0:5855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788535762.455582:0:5855:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788535762.455585:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788535762.455609:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003accebb2) 00000020:00000080:1.0:1788535762.455627:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788535762.455633:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788535762.455764:0:5855:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788535762.455772:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d36b5 00000020:00000080:1.0:1788535762.456029:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788535762.456034:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535762.456037:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535762.456039:0:5855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788535762.456041:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535762.456045:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535762.456046:0:5855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788535762.456049:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788535762.456055:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000778e624c) 00000020:00000080:1.0:1788535762.456065:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788535762.456068:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788535762.456070:0:5855:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788535762.456073:0:5855:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788535762.456078:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788535762.456119:0:5855:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000bb968a9 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788535762.456144:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000099fbcf6c) 00000020:00000080:1.0:1788535762.456152:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788535762.456226:0:5855:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788535762.456241:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74f51638375d36ca 00000020:00000080:1.0:1788535762.456323:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788535762.456329:0:5855:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788535762.456334:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x74f51638375d36d1 00080000:01000000:1.0:1788535762.456338:0:5855:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788535762.456342:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d36d8 00080000:10000000:1.0:1788535762.456736:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788535762.456975:0:5855:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788535762.466522:0:5855:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788535762.569167:0:5855:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788535762.569580:0:5855:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788535762.572885:0:5855:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788535762.573343:0:5855:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788535762.613116:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004b153a46) 00000020:00000080:2.0:1788535762.613310:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788535762.613387:0:5855:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788535762.613395:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d36e6 00000020:00000080:0.0:1788535762.621028:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788535762.626640:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788535762.675802:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788535762.718948:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788535762.756225:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:1.0:1788535762.832989:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788535762.852620:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788535762.933489:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788535762.982358:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x74f51638375d36ed 00000020:00000080:1.0:1788535762.990381:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788535762.990396:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535762.994972:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535762.994980:0:5855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788535762.994994:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535762.995002:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535762.995004:0:5855:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788535762.995008:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788535762.995090:0:5855:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788535762.995119:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535762.995123:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535762.995134:0:5855:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788535762.995138:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535762.995140:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535762.995141:0:5855:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788535762.995144:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788535762.995146:0:5855:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788535762.995189:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a79b9daa pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:5855:1875415607018752:0@lo:502: 00000100:00100000:3.0:1788535762.995276:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535762.995337:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000a3adcd going to sleep for 11 seconds 00000100:00100000:0.0:1788535762.996006:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607018752 00000100:00100000:0.0:1788535762.996015:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607018752 00000100:00100000:0.0:1788535762.996066:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788535762.996073:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006e3bc8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+9:5855:x1875415607018752:12345-0@lo:502: 00000100:00100000:0.0:1788535762.997418:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006e3bc8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+9:5855:x1875415607018752:12345-0@lo:502: Request processed in 1341us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535762.997431:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788535762.997723:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a79b9daa pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:5855:1875415607018752:0@lo:502: 00000020:01000000:3.0:1788535762.997756:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535762.997763:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535762.997766:0:5855:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788535762.997770:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788535762.998037:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788535762.998068:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788535762.998138:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 0000000029190b3c/0x74f51638375d36a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d36a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535762.998149:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 0000000029190b3c/0x74f51638375d36a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d36a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535762.998157:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a9ac46a000 from 1 10000000:01000000:0.0:1788535762.998160:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788535762.998188:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535762.998195:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535762.998203:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535762.998219:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b57d735d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607018880:0@lo:101: 00000100:00100000:0.0:1788535762.998259:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535762.998297:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f1ca78c9 going to sleep for 11 seconds 00000100:00100000:3.0:1788535762.999236:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607018880 00000100:00100000:3.0:1788535762.999246:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607018880 00000100:00100000:3.0:1788535762.999299:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788535762.999307:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc16530a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+9:5814:x1875415607018880:12345-0@lo:101: 00010000:00010000:3.0:1788535762.999321:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535762.999336:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d1d6ae0b/0x74f51638375d36fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d36f4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535762.999357:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1d6ae0b/0x74f51638375d36fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d36f4 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535762.999366:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d1d6ae0b/0x74f51638375d36fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d36f4 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535762.999374:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d1d6ae0b, rc 0) 00000100:00100000:3.0:1788535762.999412:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc16530a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+10:5814:x1875415607018880:12345-0@lo:101: Request processed in 106us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535762.999418:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788535763.002436:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b57d735d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607018880:0@lo:101: 00010000:00010000:0.0:1788535763.002464:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d36fb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.002477:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d36fb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535763.003282:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b57d735d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019008:0@lo:256: 00000100:00100000:0.0:1788535763.003360:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535763.003400:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f1ca78c9 going to sleep for 11 seconds 00000100:00100000:1.0:1788535763.003544:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607019008 00000100:00100000:1.0:1788535763.003551:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607019008 00000100:00100000:1.0:1788535763.003601:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788535763.003609:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005c45337 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+10:5814:x1875415607019008:12345-0@lo:256: 20000000:01000000:1.0:1788535763.003628:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788535763.003634:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788535763.003720:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005c45337 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+10:5814:x1875415607019008:12345-0@lo:256: Request processed in 112us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535763.003727:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788535763.003959:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b57d735d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019008:0@lo:256: 10000000:01000000:0.0:1788535763.006514:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788535763.008087:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d36fb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.008102:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d36fb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535763.008111:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a9ac46a000 from 1 10000000:01000000:0.0:1788535763.008114:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788535763.009113:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.009202:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.009213:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535763.009237:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b57d735d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019136:0@lo:101: 00000100:00100000:0.0:1788535763.009303:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535763.009358:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f1ca78c9 going to sleep for 11 seconds 00000100:00100000:1.0:1788535763.009786:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607019136 00000100:00100000:1.0:1788535763.009795:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607019136 00000100:00100000:1.0:1788535763.009844:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788535763.009851:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000943b97d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+10:5814:x1875415607019136:12345-0@lo:101: 00010000:00010000:1.0:1788535763.009864:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535763.009876:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001580075d/0x74f51638375d3709 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3702 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535763.009926:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001580075d/0x74f51638375d3709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3702 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535763.009937:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001580075d/0x74f51638375d3709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3702 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535763.009945:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001580075d, rc 0) 00000100:00100000:1.0:1788535763.009996:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000943b97d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:5814:x1875415607019136:12345-0@lo:101: Request processed in 145us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535763.010002:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788535763.010141:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b57d735d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019136:0@lo:101: 00010000:00010000:2.0:1788535763.010156:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3709 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535763.010164:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3709 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535763.010216:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008d1e16bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019264:0@lo:501: 00000100:00100000:2.0:1788535763.010245:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535763.010273:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000985a84e6 going to sleep for 11 seconds 00000100:00100000:3.0:1788535763.010321:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607019264 00000100:00100000:3.0:1788535763.010326:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607019264 00000100:00100000:3.0:1788535763.010358:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788535763.010364:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f6db078 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:5814:x1875415607019264:12345-0@lo:501: 00000100:00100000:3.0:1788535763.010965:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f6db078 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:5814:x1875415607019264:12345-0@lo:501: Request processed in 599us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535763.010974:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788535763.011211:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008d1e16bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019264:0@lo:501: 00000100:00100000:2.0:1788535763.011244:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008d1e16bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019392:0@lo:503: 00000100:00100000:2.0:1788535763.011282:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535763.011312:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000985a84e6 going to sleep for 11 seconds 00000100:00100000:1.0:1788535763.011398:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607019392 00000100:00100000:1.0:1788535763.011403:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607019392 00000100:00100000:1.0:1788535763.011429:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788535763.011435:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008020e505 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:5814:x1875415607019392:12345-0@lo:503: 00000040:00080000:1.0:1788535763.011471:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788535763.011508:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008020e505 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:5814:x1875415607019392:12345-0@lo:503: Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535763.011515:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788535763.011614:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008d1e16bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019392:0@lo:503: 00000040:00080000:0.0:1788535763.020652:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788535763.024964:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788535763.024999:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788535763.025023:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3709 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535763.025037:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3709 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535763.025093:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788535763.025096:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a9ac46a000 10000000:01000000:3.0:1788535763.025099:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a9ac46a000 10000000:01000000:3.0:1788535763.025103:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788535763.025109:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a9ac46a000 from 1 10000000:01000000:3.0:1788535763.025112:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788535763.025219:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000003bd19f7b/0x74f51638375d3710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535763.025228:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000003bd19f7b/0x74f51638375d3710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535763.025241:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000003bd19f7b/0x74f51638375d3710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535763.025265:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a79b9daa pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019520:0@lo:101: 00000100:00100000:3.0:1788535763.025342:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535763.025540:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000349bcc0b going to sleep for 11 seconds 00000100:00100000:1.0:1788535763.031150:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607019520 00000100:00100000:1.0:1788535763.031169:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607019520 00000100:00100000:1.0:1788535763.031229:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788535763.031238:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007134ac88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:5814:x1875415607019520:12345-0@lo:101: 00010000:00010000:1.0:1788535763.031257:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535763.031274:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea663500/0x74f51638375d3717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3710 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535763.031301:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea663500/0x74f51638375d3717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3710 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535763.031311:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea663500/0x74f51638375d3717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3710 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535763.031321:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea663500, rc 0) 00000100:00100000:1.0:1788535763.031393:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007134ac88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5814:x1875415607019520:12345-0@lo:101: Request processed in 156us (6052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535763.031399:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788535763.031691:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a79b9daa pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019520:0@lo:101: 00010000:00010000:3.0:1788535763.031720:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000003bd19f7b/0x74f51638375d3710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3717 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535763.031729:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000003bd19f7b/0x74f51638375d3710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3717 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535763.031797:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a79b9daa pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019648:0@lo:501: 00000100:00100000:3.0:1788535763.031834:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535763.031881:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000349bcc0b going to sleep for 11 seconds 00000100:00100000:0.0:1788535763.031962:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607019648 00000100:00100000:0.0:1788535763.031967:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607019648 00000100:00100000:0.0:1788535763.031993:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788535763.031999:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006e0c68c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5814:x1875415607019648:12345-0@lo:501: 00000100:00100000:0.0:1788535763.032276:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006e0c68c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5814:x1875415607019648:12345-0@lo:501: Request processed in 277us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535763.032284:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788535763.032464:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a79b9daa pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019648:0@lo:501: 00000100:00100000:3.0:1788535763.032496:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a79b9daa pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019776:0@lo:503: 00000100:00100000:3.0:1788535763.032535:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535763.032565:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000349bcc0b going to sleep for 11 seconds 00000100:00100000:0.0:1788535763.032676:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607019776 00000100:00100000:0.0:1788535763.032682:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607019776 00000100:00100000:0.0:1788535763.032726:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788535763.032733:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000423b559c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5814:x1875415607019776:12345-0@lo:503: 00000100:00100000:0.0:1788535763.033090:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000423b559c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5814:x1875415607019776:12345-0@lo:503: Request processed in 357us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535763.033096:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788535763.033239:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a79b9daa pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607019776:0@lo:503: 00000100:00100000:3.0:1788535763.033748:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007ae10791 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:5860:1875415607019904:0@lo:502: 00000100:00100000:3.0:1788535763.033795:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535763.033829:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 000000001454e3ed going to sleep for 11 seconds 00000100:00100000:0.0:1788535763.033919:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607019904 00000100:00100000:0.0:1788535763.033926:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607019904 00000100:00100000:0.0:1788535763.033957:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788535763.033963:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001864b932 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5860:x1875415607019904:12345-0@lo:502: 00000100:00100000:0.0:1788535763.034221:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001864b932 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5860:x1875415607019904:12345-0@lo:502: Request processed in 257us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535763.034229:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788535763.034386:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007ae10791 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:5860:1875415607019904:0@lo:502: 00000020:01000004:1.0:1788535763.034457:0:5860:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788535763.034479:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000ab870772) 00000020:00000080:1.0:1788535763.034497:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788535763.034573:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000bb968a9 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788535763.034577:0:5860:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000bb968a9 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788535763.034579:0:5860:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000bb968a9 4 00010000:00080000:1.0:1788535763.034608:0:5860:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005e829f39@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788535763.036285:0:5860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788535763.036517:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788535763.036553:0:5860:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788535763.036565:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x74f51638375d3725 00000100:00080000:1.0:1788535763.036575:0:5860:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788535763.036580:0:5860:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005e829f39 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788535763.036616:0:5860:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000096303d0b x1875415607020032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788535763.036639:0:5860:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788535763.038875:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096303d0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875415607020032:0@lo:38: 00000100:00100000:0.0:1788535763.038979:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535763.041878:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607020032 00000100:00100000:3.0:1788535763.041914:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607020032 00000100:00100000:3.0:1788535763.041954:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788535763.041960:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085a8df1c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875415607020032:12345-0@lo:38: 00000100:00100000:3.0:1788535763.042052:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085a8df1c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875415607020032:12345-0@lo:38: Request processed in 91us (3073us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788535763.042059:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788535763.042983:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e85310a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:5860:1875415607020160:0@lo:502: 00000100:00100000:1.0:1788535763.043055:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535763.043096:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c97018a going to sleep for 11 seconds 00000100:00100000:3.0:1788535763.043322:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607020160 00000100:00100000:3.0:1788535763.043329:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607020160 00000100:00100000:3.0:1788535763.043361:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788535763.043368:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008113ec69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5860:x1875415607020160:12345-0@lo:502: 00000100:00100000:3.0:1788535763.043628:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008113ec69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5860:x1875415607020160:12345-0@lo:502: Request processed in 260us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535763.043636:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788535763.043831:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e85310a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:5860:1875415607020160:0@lo:502: 00000040:00080000:2.0:1788535763.043861:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788535763.044047:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788535763.044064:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788535763.044083:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000003bd19f7b/0x74f51638375d3710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3717 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535763.044094:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000003bd19f7b/0x74f51638375d3710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3717 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788535763.044235:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788535763.044237:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788535763.044238:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788535763.044240:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788535763.044241:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788535763.044242:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788535763.044243:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788535763.044245:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788535763.044246:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788535763.044247:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788535763.044248:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788535763.044250:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788535763.044253:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788535763.044255:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788535763.044256:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788535763.044258:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788535763.044259:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788535763.044260:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788535763.044261:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788535763.044262:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788535763.044262:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788535763.044263:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788535763.044264:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788535763.044264:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788535763.044271:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788535763.044288:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788535763.044298:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007ce5e6d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607020288:0@lo:253: 00000100:00100000:3.0:1788535763.044335:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535763.044398:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000047bc0ea2 going to sleep for 11 seconds 00000100:00100000:0.0:1788535763.047615:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788535763.047631:0:3307:0:(import.c:65:import_set_state_nolock()) 000000005e829f39 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788535763.047638:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788535763.047642:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096303d0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875415607020032:0@lo:38: 00000100:00100000:2.0:1788535763.050079:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607020288 00000100:00100000:2.0:1788535763.050092:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607020288 00000100:00100000:2.0:1788535763.050237:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788535763.050246:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a7c54f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5814:x1875415607020288:12345-0@lo:253: 20000000:01000000:2.0:1788535763.050283:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788535763.050300:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788535763.098419:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788535763.098441:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788535763.098599:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788535763.098605:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788535763.098627:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.098667:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d1d6ae0b/0x74f51638375d36fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d36f4 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.098674:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.098727:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d1d6ae0b/0x74f51638375d36fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d36f4 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.098742:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d1d6ae0b/0x74f51638375d36fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d36f4 expref: 12 pid: 5827 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535763.098756:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000936dcdf7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875415607020416:0@lo:104: 00000100:00100000:0.0:1788535763.098814:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535763.098884:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 00000000601b1036 going to sleep for 11 seconds 00000100:00100000:1.0:1788535763.099117:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607020416 00000100:00100000:1.0:1788535763.099135:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607020416 00000100:00100000:1.0:1788535763.099187:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788535763.099195:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000581e14ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:5848:x1875415607020416:12345-0@lo:104: 00010000:00010000:1.0:1788535763.099207:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d36fb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535763.099265:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788535763.099270:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000581e14ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:5848:x1875415607020416:12345-0@lo:104: Request processed in 77us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535763.099287:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788535763.099308:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535763.099313:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d36fb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535763.099321:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ba34376 already unused, calling callback (00000000b03188a9) 10000000:00010000:1.0:1788535763.099324:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d36fb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535763.099331:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d36fb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535763.099337:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d36fb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535763.099342:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535763.099368:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d36fb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535763.099374:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535763.099406:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d36fb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535763.099412:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000002ba34376/0x74f51638375d36f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d36fb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535763.099428:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535763.099430:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535763.099431:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535763.099580:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005108cb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607020544:0@lo:103: 00000100:00100000:1.0:1788535763.099613:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535763.099751:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000936dcdf7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875415607020416:0@lo:104: 00010000:00010000:2.0:1788535763.099770:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535763.100137:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607020544 00000100:00100000:0.0:1788535763.100142:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607020544 00010000:00010000:0.0:1788535763.100163:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d1d6ae0b/0x74f51638375d36fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d36f4 expref: 13 pid: 5827 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535763.100193:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788535763.100199:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6458175 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:3309:x1875415607020544:12345-0@lo:103: 00010000:00010000:0.0:1788535763.100209:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535763.100214:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d1d6ae0b/0x74f51638375d36fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d36f4 expref: 13 pid: 5827 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.100223:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d1d6ae0b/0x74f51638375d36fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d36f4 expref: 13 pid: 5827 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.100247:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d1d6ae0b/0x74f51638375d36fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d36f4 expref: 13 pid: 5827 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.100259:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.100266:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788535763.100277:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001673216s 00010000:00010000:0.0:1788535763.100280:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.100286:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.100291:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.100296:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.100301:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000080557e74 already unused, calling callback (00000000084dceb9) 00010000:00010000:0.0:1788535763.100305:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.100311:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535763.114006:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a7c54f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5814:x1875415607020288:12345-0@lo:253: Request processed in 63754us (69663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535763.114022:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788535763.114251:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007ce5e6d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:5814:1875415607020288:0@lo:253: 10000000:01000000:1.0:1788535763.114267:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788535763.114271:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788535763.114273:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788535763.114275:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788535763.114276:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788535763.114278:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788535763.114279:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788535763.114280:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788535763.114282:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788535763.114283:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788535763.114284:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788535763.114286:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788535763.114287:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788535763.114306:0:5814:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788535763.117944:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535763.117965:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.119260:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.119301:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000080557e74/0x74f51638375d372c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535763.119328:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535763.119517:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6458175 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:3309:x1875415607020544:12345-0@lo:103: Request processed in 19315us (19900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535763.119528:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:1.0:1788535763.127691:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00000100:00100000:3.0:1788535763.128254:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005108cb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607020544:0@lo:103: 00080000:10000000:1.0:1788535763.128643:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788535763.129101:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788535763.132676:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788535763.135391:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788535763.135560:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788535763.139593:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788535763.139822:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788535763.140420:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788535763.140620:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788535763.141450:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788535763.141638:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788535763.197668:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788535763.247194:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788535763.247450:0:5866:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1788535763.251381:0:5865:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788535763.251388:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788535763.255411:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788535763.256050:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788535763.256932:0:5814:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788535763.256955:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788535763.257335:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788535763.259010:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788535763.259881:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788535763.259947:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788535763.262112:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788535763.262451:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1788535763.269503:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788535763.270402:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788535763.270692:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788535763.274394:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788535763.275020:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788535763.275252:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788535763.275401:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788535763.275560:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788535763.275707:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788535763.277609:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788535763.277804:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788535763.278003:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788535763.278181:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788535763.278339:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788535763.278472:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788535763.278615:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788535763.278926:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788535763.279090:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788535763.279219:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788535763.279365:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788535763.279523:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788535763.281041:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788535763.284621:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788535763.285691:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788535763.286071:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788535763.286367:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788535763.286503:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788535763.286646:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788535763.287430:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788535763.287597:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788535763.288743:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788535763.288974:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788535763.289162:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788535763.314272:0:5866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788535763.368163:0:5814:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788535763.368200:0:5814:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb59a41c6f988 00100000:10000000:0.0:1788535763.368208:0:5814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788535763.368796:0:5814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788535763.368809:0:5814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788535763.368820:0:5814:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788535763.368844:0:5814:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788535763.429227:0:5866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788535763.429304:0:5866:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788535763.429308:0:5866:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788535763.852990:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535764.877630:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535765.901969:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535766.928023:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788535767.919318:0:6109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788535767.950354:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788535768.333060:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788535768.333071:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788535768.333074:0:37:0:(import.c:65:import_set_state_nolock()) 000000005e829f39 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788535768.333087:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005e829f39 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788535768.333107:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000036d88290 x1875415607020800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788535768.333253:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda40da9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607020672:0@lo:400: 00000100:00100000:3.0:1788535768.333321:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535768.333431:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607020672 00000100:00100000:1.0:1788535768.333440:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607020672 00000100:00100000:1.0:1788535768.333483:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788535768.333505:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d665e343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:3310:x1875415607020672:12345-0@lo:400: 00000100:00100000:1.0:1788535768.333555:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d665e343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:3310:x1875415607020672:12345-0@lo:400: Request processed in 53us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535768.333562:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788535768.333627:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda40da9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607020672:0@lo:400: 00000100:00100000:2.0:1788535768.333924:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036d88290 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875415607020800:0@lo:38: 00000100:00100000:2.0:1788535768.334006:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535768.334090:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607020800 00000100:00100000:3.0:1788535768.334095:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607020800 00000100:00100000:3.0:1788535768.334125:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788535768.334130:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d1e16bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875415607020800:12345-0@lo:38: 00010000:00080000:3.0:1788535768.334150:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1788535768.334183:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x74f51638375d3733 00000004:00100000:3.0:1788535768.334226:0:5834:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788535768.334337:0:5834:0:(import.c:65:import_set_state_nolock()) 000000001b3cf210 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788535768.334383:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d1e16bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875415607020800:12345-0@lo:38: Request processed in 251us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535768.334389:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788535768.334529:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000036d88290 x1875415607020800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788535778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788535768.334552:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788535768.334558:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788535768.334562:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788535768.334563:0:3307:0:(import.c:65:import_set_state_nolock()) 000000005e829f39 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788535768.334569:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036d88290 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875415607020800:0@lo:38: 00010000:00010000:3.0:1788535768.973639:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788535769.362948:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788535769.362956:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a9ac46a000 from 3 10000000:01000000:2.0:1788535769.362961:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788535769.363004:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c2f97137/0x74f51638375d373a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.363016:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000c2f97137/0x74f51638375d373a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.363026:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000c2f97137/0x74f51638375d373a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535769.363265:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000159914b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607020928:0@lo:101: 00000100:00100000:2.0:1788535769.363384:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535769.363437:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e52d9c4 going to sleep for 11 seconds 00000100:00100000:3.0:1788535769.365630:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607020928 00000100:00100000:3.0:1788535769.365646:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607020928 00000100:00100000:3.0:1788535769.365730:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788535769.365756:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002433b7a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:5830:x1875415607020928:12345-0@lo:101: 00010000:00010000:3.0:1788535769.365773:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535769.365789:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ba298dd/0x74f51638375d3741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d373a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.365814:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ba298dd/0x74f51638375d3741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d373a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.365824:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ba298dd/0x74f51638375d3741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d373a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.365833:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ba298dd, rc 0) 00000100:00100000:3.0:1788535769.365933:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002433b7a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5830:x1875415607020928:12345-0@lo:101: Request processed in 179us (2550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535769.365948:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788535769.366188:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000159914b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607020928:0@lo:101: 00010000:00010000:2.0:1788535769.366209:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000c2f97137/0x74f51638375d373a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3741 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.366220:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000c2f97137/0x74f51638375d373a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3741 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535769.366283:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000159914b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607021056:0@lo:256: 00000100:00100000:2.0:1788535769.366329:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535769.366365:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e52d9c4 going to sleep for 11 seconds 00000100:00100000:3.0:1788535769.367072:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607021056 00000100:00100000:3.0:1788535769.367080:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607021056 00000100:00100000:3.0:1788535769.367182:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788535769.367190:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3443bf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5830:x1875415607021056:12345-0@lo:256: 20000000:01000000:3.0:1788535769.367207:0:5826:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788535769.367223:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788535769.367226:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788535769.367314:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3443bf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5830:x1875415607021056:12345-0@lo:256: Request processed in 125us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535769.367322:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788535769.367411:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000159914b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607021056:0@lo:256: 10000000:01000000:1.0:1788535769.367517:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788535769.367523:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c2f97137/0x74f51638375d373a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3741 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.367532:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000c2f97137/0x74f51638375d373a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3741 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.997045:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535771.026627:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535772.045033:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788535772.778807:0:6311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7855c060 20000000:00000080:2.0:1788535772.778825:0:6311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a986e9f800 uarg=0000000000000000 20000000:01000000:2.0:1788535772.778858:0:6311:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788535772.778865:0:6311:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788535772.778869:0:6311:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788535772.779680:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788535772.779694:0:6311:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788535772.784716:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788535772.785198:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788535772.787418:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788535772.787524:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788535772.787544:0:6311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788535772.787561:0:6311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535772.787578:0:6311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001580075d/0x74f51638375d3709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3702 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535772.787585:0:6311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535772.787631:0:6311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001580075d/0x74f51638375d3709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d3702 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535772.787645:0:6311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001580075d/0x74f51638375d3709 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d3702 expref: 11 pid: 5826 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535772.787657:0:6311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e909558 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1875415607021184:0@lo:104: 00000100:00100000:2.0:1788535772.787714:0:6311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535772.787776:0:6311:0:(client.c:2716:ptlrpc_set_wait()) set 000000007a8b88f1 going to sleep for 11 seconds 00000100:00100000:3.0:1788535772.788200:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607021184 00000100:00100000:3.0:1788535772.788209:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607021184 00000100:00100000:3.0:1788535772.788267:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788535772.788275:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c80c5e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:6311:x1875415607021184:12345-0@lo:104: 00010000:00010000:3.0:1788535772.788293:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3709 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.788675:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788535772.788681:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c80c5e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:6311:x1875415607021184:12345-0@lo:104: Request processed in 408us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535772.788688:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788535772.788709:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535772.788714:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3709 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.788721:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000735a726 already unused, calling callback (00000000b03188a9) 10000000:00010000:3.0:1788535772.788724:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d3709 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.788731:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d3709 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535772.788737:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d3709 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535772.788741:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788535772.789007:0:6311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e909558 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1875415607021184:0@lo:104: 00010000:00010000:2.0:1788535772.789026:0:6311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789556:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3709 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789565:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535772.789600:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3709 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789607:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000000735a726/0x74f51638375d3702 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3709 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789632:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535772.789634:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535772.789635:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535772.789643:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535772.789658:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb3f9d8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607021312:0@lo:103: 00000100:00100000:3.0:1788535772.789701:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535772.789747:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607021312 00000100:00100000:3.0:1788535772.789753:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607021312 00010000:00010000:3.0:1788535772.789774:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001580075d/0x74f51638375d3709 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3702 expref: 12 pid: 5826 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535772.789800:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788535772.789807:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3e9d949 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:3310:x1875415607021312:12345-0@lo:103: 00010000:00010000:3.0:1788535772.789819:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535772.789823:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001580075d/0x74f51638375d3709 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3702 expref: 12 pid: 5826 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789834:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001580075d/0x74f51638375d3709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d3702 expref: 12 pid: 5826 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789846:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001580075d/0x74f51638375d3709 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d3702 expref: 12 pid: 5826 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789858:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789865:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789912:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789919:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789924:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789929:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789933:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001b5dd906 already unused, calling callback (00000000084dceb9) 00010000:00010000:3.0:1788535772.789937:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789942:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789953:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535772.789961:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535772.789992:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3e9d949 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:3310:x1875415607021312:12345-0@lo:103: Request processed in 187us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535772.789999:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788535772.790032:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb3f9d8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607021312:0@lo:103: 00010000:00010000:2.0:1788535772.790687:0:6311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535772.790700:0:6311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535772.790705:0:6311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001b5dd906/0x74f51638375d3748 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535773.069167:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535773.453145:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb3f9d8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607021440:0@lo:400: 00000100:00100000:1.0:1788535773.453221:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535773.453433:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042df5abf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607021568:0@lo:400: 00000100:00100000:2.0:1788535773.453470:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535773.453520:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607021568 00000100:00100000:2.0:1788535773.453528:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607021568 00000100:00100000:2.0:1788535773.453570:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788535773.453578:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e909558 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607021568:12345-0@lo:400: 00000100:00100000:2.0:1788535773.453649:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e909558 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607021568:12345-0@lo:400: Request processed in 72us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535773.453656:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788535773.453696:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000042df5abf x1875415607021568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535773.453708:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042df5abf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607021568:0@lo:400: 00000100:00100000:0.0:1788535773.454095:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607021440 00000100:00100000:0.0:1788535773.454101:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607021440 00000100:00100000:0.0:1788535773.454295:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788535773.454303:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cedb6126 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:3308:x1875415607021440:12345-0@lo:400: 00000100:00100000:0.0:1788535773.455367:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cedb6126 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:3308:x1875415607021440:12345-0@lo:400: Request processed in 1061us (2142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535773.455379:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788535773.455455:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb3f9d8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607021440:0@lo:400: 00010000:00010000:3.0:1788535774.092995:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788535774.733019:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788535774.733027:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a9ac46a000 from 1 10000000:01000000:1.0:1788535774.733032:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788535774.733696:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000004c30d8fe/0x74f51638375d374f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535774.733708:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000004c30d8fe/0x74f51638375d374f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535774.733820:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000004c30d8fe/0x74f51638375d374f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535774.733842:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda40da9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607021696:0@lo:101: 00000100:00100000:1.0:1788535774.734213:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535774.734871:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607021696 00000100:00100000:3.0:1788535774.734916:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607021696 00000100:00100000:3.0:1788535774.734963:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788535774.734971:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1662408 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:5830:x1875415607021696:12345-0@lo:101: 00010000:00010000:3.0:1788535774.734984:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535774.734998:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000027c43044/0x74f51638375d3756 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d374f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535774.735022:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000027c43044/0x74f51638375d3756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d374f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535774.735032:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000027c43044/0x74f51638375d3756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d374f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535774.735063:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000027c43044, rc 0) 00000100:00100000:3.0:1788535774.735106:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1662408 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5830:x1875415607021696:12345-0@lo:101: Request processed in 136us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535774.735113:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788535774.736703:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 000000004d30d742 going to sleep for 11 seconds 00000100:00100000:0.0:1788535774.736748:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda40da9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607021696:0@lo:101: 00010000:00010000:0.0:1788535774.736786:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000004c30d8fe/0x74f51638375d374f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3756 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535774.736797:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000004c30d8fe/0x74f51638375d374f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3756 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535774.736863:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097e338f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607021824:0@lo:501: 00000100:00100000:0.0:1788535774.736928:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535774.737230:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607021824 00000100:00100000:1.0:1788535774.737237:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607021824 00000100:00100000:1.0:1788535774.737278:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788535774.737285:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8cc495c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5830:x1875415607021824:12345-0@lo:501: 00000100:00100000:1.0:1788535774.737507:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8cc495c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5830:x1875415607021824:12345-0@lo:501: Request processed in 223us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535774.737515:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788535774.737610:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 000000002efc20c6 going to sleep for 11 seconds 00000100:00100000:0.0:1788535774.737625:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097e338f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607021824:0@lo:501: 00000100:00100000:0.0:1788535774.737651:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097e338f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607021952:0@lo:503: 00000100:00100000:0.0:1788535774.737685:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535774.737812:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 000000002efc20c6 going to sleep for 11 seconds 00000100:00100000:3.0:1788535774.737851:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607021952 00000100:00100000:3.0:1788535774.737855:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607021952 00000100:00100000:3.0:1788535774.738047:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788535774.738055:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003acccacb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5830:x1875415607021952:12345-0@lo:503: 00000100:00100000:3.0:1788535774.738203:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003acccacb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5830:x1875415607021952:12345-0@lo:503: Request processed in 149us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535774.738210:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788535774.738273:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097e338f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607021952:0@lo:503: 00000100:00100000:0.0:1788535774.738743:0:6390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097e338f9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:6390:1875415607022080:0@lo:502: 00000100:00100000:0.0:1788535774.738781:0:6390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535774.739056:0:6390:0:(client.c:2716:ptlrpc_set_wait()) set 00000000893db689 going to sleep for 11 seconds 00000100:00100000:1.0:1788535774.739660:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607022080 00000100:00100000:1.0:1788535774.739668:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607022080 00000100:00100000:0.0:1788535774.742272:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788535774.742284:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fc7577b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6390:x1875415607022080:12345-0@lo:502: 00000100:00100000:0.0:1788535774.742554:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fc7577b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6390:x1875415607022080:12345-0@lo:502: Request processed in 272us (3772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535774.742563:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788535774.742664:0:6390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097e338f9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:6390:1875415607022080:0@lo:502: 00000020:01000000:1.0:1788535774.742700:0:6390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535774.742710:0:6390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535774.742713:0:6390:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788535774.742721:0:6390:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a9ac46a000 00000020:00000080:1.0:1788535774.742723:0:6390:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788535774.742849:0:6390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:6390:1875415607022208:0@lo:502: 00000100:00100000:1.0:1788535774.742934:0:6390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535774.742963:0:6390:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9861c5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535774.743139:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607022208 00000100:00100000:3.0:1788535774.743145:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607022208 00000100:00100000:3.0:1788535774.743169:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788535774.743175:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6390:x1875415607022208:12345-0@lo:502: 00000100:00100000:3.0:1788535774.743308:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6390:x1875415607022208:12345-0@lo:502: Request processed in 132us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535774.743321:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788535774.743363:0:6390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:6390:1875415607022208:0@lo:502: 00000020:01000000:1.0:1788535774.743382:0:6390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535774.743387:0:6390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535774.743394:0:6390:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788535774.743397:0:6390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788535774.743494:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788535774.743513:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788535774.743522:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981652600/0x74f51638375d374f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3756 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535774.743539:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a981652600/0x74f51638375d374f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3756 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535775.117179:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535776.141117:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535777.167225:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535778.189111:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535778.573443:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535778.573498:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607022464:0@lo:400: 00000100:00100000:1.0:1788535778.573575:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535778.573627:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607022336:0@lo:400: 00000100:00100000:1.0:1788535778.573657:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535778.573728:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607022464 00000100:00100000:1.0:1788535778.573735:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607022464 00000100:00100000:1.0:1788535778.573783:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788535778.573792:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607022464:12345-0@lo:400: 00000100:00100000:1.0:1788535778.573841:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607022464:12345-0@lo:400: Request processed in 50us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535778.573849:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788535778.573928:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a986aa3800 x1875415607022464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535778.573942:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607022464:0@lo:400: 00000100:00100000:3.0:1788535778.574033:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607022336 00000100:00100000:3.0:1788535778.574038:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607022336 00000100:00100000:3.0:1788535778.574066:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788535778.574074:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:3311:x1875415607022336:12345-0@lo:400: 00000100:00100000:3.0:1788535778.574108:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:3311:x1875415607022336:12345-0@lo:400: Request processed in 35us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535778.574114:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788535778.574209:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607022336:0@lo:400: 00000020:01000004:0.0:1788535778.600654:0:6669:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788535778.600657:0:6669:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788535778.600774:0:6669:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a9a7dac800 00000020:01000004:0.0:1788535778.600791:0:6669:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788535778.600801:0:6669:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788535778.600823:0:6669:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97a9b91d0000) 00000020:00000080:0.0:1788535778.600838:0:6669:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788535778.626579:0:6669:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788535778.626827:0:6669:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788535778.657642:0:6669:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788535778.664634:0:6669:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788535778.664668:0:6669:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788535778.664725:0:6669:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788535778.664752:0:6669:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788535778.666053:0:6669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788535778.666066:0:6669:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788535778.666078:0:6669:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x74f51638375d3764 00000020:01000004:2.0:1788535778.666086:0:6669:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788535778.666117:0:6669:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788535778.666120:0:6669:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788535778.666126:0:6669:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788535778.666131:0:6669:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788535778.666142:0:6669:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97a990fa4d40) 00000020:00000080:2.0:1788535778.666152:0:6669:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788535778.667305:0:6669:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788535778.667484:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788535778.667491:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788535778.673599:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788535778.673615:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788535778.674006:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788535778.674023:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788535778.680777:0:6669:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788535778.681239:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788535778.681246:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788535778.682182:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788535778.682192:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788535778.725639:0:6669:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788535778.726487:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788535778.726496:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788535778.728584:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788535778.728597:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788535778.730805:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788535778.730820:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788535778.734606:0:6669:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788535778.734884:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788535778.734966:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788535778.737912:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788535778.737940:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788535778.819815:0:6669:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788535778.820316:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788535778.820322:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788535778.823158:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788535778.823174:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788535778.823863:0:6669:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788535778.823930:0:6669:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788535778.823937:0:6669:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788535778.860869:0:6669:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788535778.861097:0:6669:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788535778.861102:0:6669:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788535778.861104:0:6669:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788535778.861105:0:6669:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788535778.861106:0:6669:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788535778.861108:0:6669:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788535778.861109:0:6669:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788535778.861111:0:6669:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788535778.861112:0:6669:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788535778.861179:0:6669:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788535778.861182:0:6669:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788535778.861183:0:6669:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788535778.861186:0:6669:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788535778.861189:0:6669:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788535778.861190:0:6669:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788535778.861197:0:6669:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788535778.861198:0:6669:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788535778.861199:0:6669:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788535778.861200:0:6669:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788535778.861201:0:6669:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788535778.861202:0:6669:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788535778.861203:0:6669:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788535778.861204:0:6669:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788535778.861205:0:6669:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788535778.861231:0:6669:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788535778.861248:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607022592:0@lo:253: 00000100:00100000:3.0:1788535778.861323:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.861441:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba304540 going to sleep for 11 seconds 00000100:00100000:0.0:1788535778.861597:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607022592 00000100:00100000:0.0:1788535778.861605:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607022592 00000100:00100000:0.0:1788535778.861768:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788535778.861779:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607022592:12345-0@lo:253: 20000000:01000000:0.0:1788535778.861807:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788535778.861811:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788535778.861816:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788535778.861820:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788535778.863758:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788535778.864285:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788535778.864300:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788535778.864342:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788535778.864351:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788535778.864402:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788535778.864537:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788535778.865284:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788535778.865308:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:1.0:1788535778.865310:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:1.0:1788535778.865358:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788535778.865368:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788535778.865506:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788535778.865516:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:1.0:1788535778.865580:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788535778.865603:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788535778.865647:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788535778.865701:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788535778.868871:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788535778.868932:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:1.0:1788535778.868935:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:1.0:1788535778.868972:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788535778.868981:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788535778.869011:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788535778.869020:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:1.0:1788535778.869065:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788535778.869075:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788535778.869107:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788535778.869143:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788535778.869160:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788535778.869163:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788535778.869166:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788535778.869179:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788535778.869181:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788535778.869213:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788535778.869216:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788535778.870494:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788535778.871843:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788535778.871952:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788535778.872093:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788535778.872108:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788535778.872111:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788535778.872770:0:6685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788535778.872823:0:6685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788535778.872872:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788535778.873687:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788535778.873733:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788535778.873768:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788535778.873780:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788535778.873782:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788535778.874392:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1788535778.874518:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1788535778.874573:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788535778.874816:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788535778.874846:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788535778.877814:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788535778.877855:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788535778.877857:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788535778.877867:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788535778.877919:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.877937:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a98ab4a400/0x74f51638375d368b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3684 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.877964:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9c216da00/0x74f51638375d36a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d36a0 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.877971:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981653000/0x74f51638375d3717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3710 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.877979:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.878028:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981653000/0x74f51638375d3717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d3710 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.878044:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a981653000/0x74f51638375d3717 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d3710 expref: 12 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535778.878059:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607022720:0@lo:104: 00000100:00100000:3.0:1788535778.878131:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788535778.878182:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9c216da00/0x74f51638375d36a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d36a0 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.878190:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a9c216da00/0x74f51638375d36a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d36a0 expref: 12 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535778.878197:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607022848:0@lo:104: 00000100:00100000:3.0:1788535778.878219:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788535778.878254:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a98ab4a400/0x74f51638375d368b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d3684 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.878263:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a98ab4a400/0x74f51638375d368b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d3684 expref: 12 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535778.878279:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607022976:0@lo:104: 00000100:00100000:3.0:1788535778.878315:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.878326:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba304f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535778.878768:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607022720 00000100:00100000:2.0:1788535778.878778:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607022720 00000100:00100000:2.0:1788535778.878816:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607022848 00000100:00100000:2.0:1788535778.878819:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607022848 00000100:00100000:2.0:1788535778.878827:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607022976 00000100:00100000:2.0:1788535778.878829:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607022976 00000100:00100000:2.0:1788535778.878849:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788535778.878856:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:5826:x1875415607022720:12345-0@lo:104: 00010000:00010000:2.0:1788535778.878869:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a200/0x74f51638375d3710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3717 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.878953:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788535778.878959:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:5826:x1875415607022720:12345-0@lo:104: Request processed in 104us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.878965:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788535778.878980:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788535778.878985:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+4:5826:x1875415607022848:12345-0@lo:104: 00010000:00010000:2.0:1788535778.878992:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d36a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d36a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879186:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788535778.879192:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+4:5826:x1875415607022848:12345-0@lo:104: Request processed in 207us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.879198:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788535778.879210:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788535778.879216:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:5826:x1875415607022976:12345-0@lo:104: 00010000:00010000:2.0:1788535778.879223:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d3684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d368b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879262:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788535778.879267:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:5826:x1875415607022976:12345-0@lo:104: Request processed in 52us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.879273:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788535778.879287:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788535778.879299:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a200/0x74f51638375d3710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3717 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879305:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:2.0:1788535778.879309:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a200/0x74f51638375d3710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d3717 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879317:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a200/0x74f51638375d3710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d3717 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535778.879324:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a200/0x74f51638375d3710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d3717 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535778.879329:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788535778.879359:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a200/0x74f51638375d3710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3717 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879365:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535778.879381:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a200/0x74f51638375d3710 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3717 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879387:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a200/0x74f51638375d3710 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3717 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879399:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788535778.879402:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d36a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d36a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535778.879486:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535778.879521:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980031400 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:2.0:1788535778.879524:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d36a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d36a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879539:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d36a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d36a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535778.879545:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d36a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d36a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535778.879560:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788535778.879573:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d36a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d36a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879579:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535778.879584:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d36a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d36a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879590:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d36a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d36a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879601:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535778.879602:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535778.879604:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535778.879623:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607023104:0@lo:103: 00000100:00100000:2.0:1788535778.879653:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.879686:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788535778.879692:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607023232:0@lo:103: 00000100:00100000:2.0:1788535778.879711:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.879744:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607023104 00000100:00100000:2.0:1788535778.879748:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607023104 00010000:00010000:2.0:1788535778.879768:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981653000/0x74f51638375d3717 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3710 expref: 13 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535778.879799:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607023232 00000100:00100000:2.0:1788535778.879803:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607023232 00010000:00010000:2.0:1788535778.879814:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9c216da00/0x74f51638375d36a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d36a0 expref: 14 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535778.879825:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788535778.879831:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:3308:x1875415607023104:12345-0@lo:103: 00010000:00010000:2.0:1788535778.879839:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535778.879845:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981653000/0x74f51638375d3717 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3710 expref: 14 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879855:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981653000/0x74f51638375d3717 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d3710 expref: 14 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879869:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535778.879933:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:3308:x1875415607023104:12345-0@lo:103: Request processed in 102us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.879939:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788535778.879950:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788535778.879956:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:3308:x1875415607023232:12345-0@lo:103: 00010000:00010000:2.0:1788535778.879962:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535778.879967:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9c216da00/0x74f51638375d36a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d36a0 expref: 13 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879974:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9c216da00/0x74f51638375d36a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d36a0 expref: 13 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.879982:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535778.880010:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:3308:x1875415607023232:12345-0@lo:103: Request processed in 54us (298us total) trans 0 rc 0/0 00010000:00010000:3.0:1788535778.880322:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981653000/0x74f51638375d3717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d3710 expref: 13 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535778.880333:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607022720:0@lo:104: 00010000:00010000:3.0:1788535778.880345:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9c216da00/0x74f51638375d36a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d36a0 expref: 12 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535778.880352:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607022848:0@lo:104: 00000100:00100000:3.0:1788535778.880360:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607022976:0@lo:104: 00010000:00010000:3.0:1788535778.880381:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535778.880478:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788535778.880512:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607023232:0@lo:103: 00000100:00100000:2.0:1788535778.880520:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607023104:0@lo:103: 00010000:00010000:0.0:1788535778.883561:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535778.883567:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535778.883570:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535778.883598:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d3684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d368b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.883623:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980030200 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:1.0:1788535778.883627:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d3684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d368b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.883638:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d3684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d368b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535778.883645:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d3684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d368b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535778.883651:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535778.883731:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d3684 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d368b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.883737:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535778.883765:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d3684 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d368b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.883772:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d3684 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d368b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.883792:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535778.883794:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535778.883796:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535778.883837:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607023360:0@lo:103: 00000100:00100000:0.0:1788535778.883925:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535778.884145:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607023360 00000100:00100000:1.0:1788535778.884154:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607023360 00010000:00010000:1.0:1788535778.884178:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a98ab4a400/0x74f51638375d368b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3684 expref: 11 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535778.884211:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788535778.884228:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:3310:x1875415607023360:12345-0@lo:103: 00010000:00010000:1.0:1788535778.884240:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535778.884245:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a98ab4a400/0x74f51638375d368b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3684 expref: 11 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.884257:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a98ab4a400/0x74f51638375d368b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d3684 expref: 11 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.884271:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4a400/0x74f51638375d368b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d3684 expref: 11 pid: 5825 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.884284:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.884292:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.884305:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.884311:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.884317:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.884323:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.884328:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4ac00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788535778.884332:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.884345:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535778.884633:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535778.884642:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788535778.884650:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1788535778.885382:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.885393:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3772 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.885420:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535778.885480:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+10:3310:x1875415607023360:12345-0@lo:103: Request processed in 1252us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535778.885489:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788535778.885540:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607023360:0@lo:103: 00000100:00100000:3.0:1788535778.981472:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+9:6669:x1875415607022592:12345-0@lo:253: Request processed in 119685us (120139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535778.981490:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788535778.981606:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607022592:0@lo:253: 10000000:01000000:0.0:1788535778.981622:0:6669:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788535778.981626:0:6669:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788535778.981627:0:6669:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788535778.981629:0:6669:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788535778.981630:0:6669:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788535778.981631:0:6669:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788535778.981633:0:6669:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788535778.981634:0:6669:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788535778.981635:0:6669:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788535778.981637:0:6669:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788535778.981654:0:6669:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788535778.981675:0:6669:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a9a7dac800 from lustre-OST0000 10000000:01000000:0.0:1788535778.981713:0:6669:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788535778.981716:0:6669:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788535778.981723:0:6669:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97a986be19c0 local copy 10000000:01000000:0.0:1788535778.981727:0:6669:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788535778.981768:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535778.981779:0:6669:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535778.981789:0:6669:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535778.981807:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607023488:0@lo:101: 00000100:00100000:0.0:1788535778.981844:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535778.981918:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986e91840 going to sleep for 11 seconds 00000100:00100000:3.0:1788535778.982161:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607023488 00000100:00100000:3.0:1788535778.982168:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607023488 00000100:00100000:3.0:1788535778.982219:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788535778.982229:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+9:6669:x1875415607023488:12345-0@lo:101: 00010000:00010000:3.0:1788535778.982242:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535778.982257:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3779 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.982284:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3779 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.982305:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3779 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.982317:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4ac00, rc 0) 00000100:00100000:3.0:1788535778.982354:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+10:6669:x1875415607023488:12345-0@lo:101: Request processed in 127us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535778.982362:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788535778.982471:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607023488:0@lo:101: 00010000:00010000:0.0:1788535778.982485:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x74f51638375d3780 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535778.982496:0:6669:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x74f51638375d3780 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535778.982606:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607023616:0@lo:501: 00000100:00100000:0.0:1788535778.982634:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535778.982662:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986e91840 going to sleep for 11 seconds 00000100:00100000:3.0:1788535778.982772:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607023616 00000100:00100000:3.0:1788535778.982777:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607023616 00000100:00100000:3.0:1788535778.982808:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788535778.982815:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+10:6669:x1875415607023616:12345-0@lo:501: 00000100:00100000:3.0:1788535778.983151:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+10:6669:x1875415607023616:12345-0@lo:501: Request processed in 335us (514us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788535778.983159:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788535778.983294:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607023616:0@lo:501: 10000000:01000000:2.0:1788535778.983310:0:6669:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788535778.983343:0:6669:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788535778.983349:0:6669:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x74f51638375d3780 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.983357:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x74f51638375d3780 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.983364:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x74f51638375d3780 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.983386:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788535778.983404:0:6669:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a9a7dac800 10000000:01000000:2.0:1788535778.983409:0:6669:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788535778.983415:0:6669:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97a986be19c0 10000000:01000000:2.0:1788535778.983417:0:6669:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788535778.983420:0:6669:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff97a986be19c0 from 1 10000000:01000000:2.0:1788535778.983424:0:6669:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788535778.983444:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216d200/0x74f51638375d3787 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.983452:0:6669:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9c216d200/0x74f51638375d3787 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.983468:0:6669:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9c216d200/0x74f51638375d3787 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535778.983483:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607023744:0@lo:101: 00000100:00100000:2.0:1788535778.983512:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.983538:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99cbd0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535778.983564:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607023744 00000100:00100000:2.0:1788535778.983569:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607023744 00000100:00100000:2.0:1788535778.983599:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788535778.983606:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+10:6669:x1875415607023744:12345-0@lo:101: 00010000:00010000:2.0:1788535778.983615:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535778.983625:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9c216d800/0x74f51638375d378e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3787 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.983642:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9c216d800/0x74f51638375d378e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3787 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.983651:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9c216d800/0x74f51638375d378e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3787 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.983660:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216d800, rc 0) 00000100:00100000:2.0:1788535778.983701:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:6669:x1875415607023744:12345-0@lo:101: Request processed in 95us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.983707:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788535778.983739:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607023744:0@lo:101: 00010000:00010000:2.0:1788535778.983755:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9c216d200/0x74f51638375d3787 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d378e expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.983774:0:6669:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9c216d200/0x74f51638375d3787 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d378e expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535778.983791:0:6669:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788535778.983800:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216d200/0x74f51638375d3787 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d378e expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.983808:0:6669:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9c216d200/0x74f51638375d3787 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d378e expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535778.983814:0:6669:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788535778.983818:0:6669:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788535778.983822:0:6669:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788535778.983825:0:6669:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788535778.983838:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.983845:0:6669:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.983853:0:6669:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535778.983863:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607023872:0@lo:101: 00000100:00100000:2.0:1788535778.983917:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.983947:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99cbd0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535778.983964:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607023872 00000100:00100000:2.0:1788535778.983967:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607023872 00000100:00100000:2.0:1788535778.983995:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788535778.984002:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:6669:x1875415607023872:12345-0@lo:101: 00010000:00010000:2.0:1788535778.984009:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535778.984028:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9c216c000/0x74f51638375d379c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3795 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.984041:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9c216c000/0x74f51638375d379c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3795 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.984049:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9c216c000/0x74f51638375d379c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3795 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.984056:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216c000, rc 0) 00000100:00100000:2.0:1788535778.984083:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607023872:12345-0@lo:101: Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.984089:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788535778.984116:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607023872:0@lo:101: 00010000:00010000:2.0:1788535778.984127:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d379c expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.984135:0:6669:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d379c expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535778.984203:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024000:0@lo:501: 00000100:00100000:2.0:1788535778.984227:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.984240:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99cbd0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535778.984252:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607024000 00000100:00100000:2.0:1788535778.984255:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607024000 00000100:00100000:2.0:1788535778.984274:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788535778.984285:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607024000:12345-0@lo:501: 00000100:00100000:2.0:1788535778.984481:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607024000:12345-0@lo:501: Request processed in 195us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.984488:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788535778.984520:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024000:0@lo:501: 00000100:00100000:2.0:1788535778.984555:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024128:0@lo:503: 00000100:00100000:2.0:1788535778.984594:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.984607:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99cbd0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535778.984619:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607024128 00000100:00100000:2.0:1788535778.984622:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607024128 00000100:00100000:2.0:1788535778.984642:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788535778.984648:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607024128:12345-0@lo:503: 00000100:00100000:2.0:1788535778.984792:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607024128:12345-0@lo:503: Request processed in 144us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.984799:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788535778.984840:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024128:0@lo:503: 00000040:00080000:2.0:1788535778.985106:0:6669:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788535778.985155:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024256:0@lo:502: 00000100:00100000:2.0:1788535778.985189:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.985212:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99cbd0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535778.985226:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607024256 00000100:00100000:2.0:1788535778.985229:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607024256 00000100:00100000:2.0:1788535778.985248:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788535778.985255:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607024256:12345-0@lo:502: 00000100:00100000:2.0:1788535778.985381:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607024256:12345-0@lo:502: Request processed in 126us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.985396:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788535778.985433:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024256:0@lo:502: 00000040:00080000:2.0:1788535778.985682:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788535778.985727:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788535778.985759:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788535778.985807:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788535778.985858:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788535778.985922:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788535778.985946:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024384:0@lo:502: 00000100:00100000:2.0:1788535778.985982:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.986006:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99cbd0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535778.986023:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607024384 00000100:00100000:2.0:1788535778.986027:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607024384 00000100:00100000:2.0:1788535778.986049:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788535778.986054:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607024384:12345-0@lo:502: 00000100:00100000:2.0:1788535778.986181:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607024384:12345-0@lo:502: Request processed in 125us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.986188:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788535778.986230:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024384:0@lo:502: 00000040:00080000:2.0:1788535778.986304:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788535778.986314:0:6669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00010000:00010000:3.0:1788535778.987159:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535778.987168:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x74f51638375d3780 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.987179:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980030a00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535778.987183:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x74f51638375d3780 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.987194:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x74f51638375d3780 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535778.987201:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x74f51638375d3780 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535778.987221:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535778.987251:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74f51638375d3780 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.987258:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535778.987280:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74f51638375d3780 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.987289:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a980030a00/0x74f51638375d3779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74f51638375d3780 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.987305:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535778.987307:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535778.987309:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535778.987323:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607024512:0@lo:103: 00000100:00100000:3.0:1788535778.987383:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.987690:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607024512 00000100:00100000:3.0:1788535778.987698:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607024512 00000100:00100000:3.0:1788535778.987750:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788535778.987757:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:3311:x1875415607024512:12345-0@lo:103: 00010000:00010000:3.0:1788535778.987769:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535778.987785:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4ac00/0x74f51638375d3780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d3779 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.987798:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535778.987834:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:3311:x1875415607024512:12345-0@lo:103: Request processed in 77us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535778.987841:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788535778.987883:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607024512:0@lo:103: 00000020:01000000:0.0:1788535778.989607:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788535778.989621:0:6688:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788535778.989645:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535778.989647:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788535778.989654:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788535778.989669:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97a9b91d3380) 00000020:00000080:0.0:1788535778.989779:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788535778.989788:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788535778.989876:0:6688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a9a7dac800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788535778.989883:0:6688:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788535778.990104:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x74f51638375d37aa 00010000:00010000:2.0:1788535778.997303:0:6688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788535778.997840:0:6688:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788535779.002193:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788535779.002788:0:6688:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788535779.022797:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788535779.024118:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788535779.028226:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788535779.028241:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788535779.028248:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535779.028251:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788535779.028255:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788535779.028259:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535779.028260:0:6688:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788535779.028264:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788535779.028266:0:6688:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788535779.028323:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788535779.028328:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535779.028330:0:6688:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788535779.028333:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788535779.029314:0:6669:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788535779.029417:0:6669:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788535779.029442:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d379c expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.029457:0:6669:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d379c expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535779.029466:0:6669:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a9a7dac800 from 1 10000000:01000000:3.0:1788535779.029469:0:6669:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788535779.029507:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.029516:0:6669:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.029527:0:6669:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535779.029565:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024640:0@lo:101: 00000100:00100000:3.0:1788535779.029639:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.029732:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987964840 going to sleep for 11 seconds 00000100:00100000:1.0:1788535779.040445:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607024640 00000100:00100000:1.0:1788535779.040465:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607024640 00000100:00100000:1.0:1788535779.040536:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788535779.040557:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:6669:x1875415607024640:12345-0@lo:101: 00010000:00010000:1.0:1788535779.040575:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535779.040598:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981653c00/0x74f51638375d37b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d37b1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.040626:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981653c00/0x74f51638375d37b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d37b1 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.040638:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981653c00/0x74f51638375d37b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d37b1 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.040665:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981653c00, rc 0) 00000100:00100000:1.0:1788535779.040757:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607024640:12345-0@lo:101: Request processed in 212us (11117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.040764:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788535779.044280:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024640:0@lo:101: 00010000:00010000:2.0:1788535779.044313:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d37b8 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.044327:0:6669:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d37b8 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535779.045608:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024768:0@lo:501: 00000100:00100000:2.0:1788535779.045676:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.045759:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988946d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535779.053192:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607024768 00000100:00100000:0.0:1788535779.053209:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607024768 00000100:00100000:0.0:1788535779.053264:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788535779.053274:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607024768:12345-0@lo:501: 00000100:00100000:0.0:1788535779.053603:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607024768:12345-0@lo:501: Request processed in 329us (7925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.053610:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788535779.053964:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024768:0@lo:501: 00000100:00100000:3.0:1788535779.054028:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024896:0@lo:503: 00000100:00100000:3.0:1788535779.054074:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.054104:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987964840 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.054660:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607024896 00000100:00100000:2.0:1788535779.054669:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607024896 00000100:00100000:2.0:1788535779.054713:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788535779.054722:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607024896:12345-0@lo:503: 00000100:00100000:2.0:1788535779.055169:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607024896:12345-0@lo:503: Request processed in 447us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.055177:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788535779.058730:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607024896:0@lo:503: 00000040:00080000:1.0:1788535779.059384:0:6669:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788535779.059464:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025024:0@lo:502: 00000100:00100000:1.0:1788535779.059530:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535779.059580:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a984ed8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.059686:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607025024 00000100:00100000:2.0:1788535779.059693:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607025024 00000100:00100000:2.0:1788535779.059743:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788535779.059753:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607025024:12345-0@lo:502: 00000100:00100000:2.0:1788535779.060130:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607025024:12345-0@lo:502: Request processed in 264us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.060139:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788535779.060322:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025024:0@lo:502: 00000040:00080000:1.0:1788535779.060637:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788535779.060679:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788535779.060705:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025152:0@lo:502: 00000100:00100000:1.0:1788535779.060744:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535779.060775:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a984ed8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.061266:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607025152 00000100:00100000:2.0:1788535779.061272:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607025152 00000100:00100000:2.0:1788535779.061304:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788535779.061311:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607025152:12345-0@lo:502: 00000100:00100000:2.0:1788535779.061639:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607025152:12345-0@lo:502: Request processed in 326us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.061648:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788535779.066263:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025152:0@lo:502: 00000040:00080000:3.0:1788535779.066584:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788535779.066600:0:6669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788535779.071640:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788535779.071655:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535779.071657:0:6692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788535779.071679:0:6692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a9a7dac800 00000020:00000080:0.0:1788535779.071682:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788535779.071707:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788535779.071711:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535779.071712:0:6692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788535779.071715:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788535779.071879:0:6669:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788535779.071950:0:6669:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788535779.071968:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d37b8 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.071981:0:6669:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d37b8 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535779.072259:0:6669:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788535779.072263:0:6669:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a9a7dac800 10000000:01000000:3.0:1788535779.072267:0:6669:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a9a7dac800 10000000:01000000:3.0:1788535779.072271:0:6669:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788535779.072276:0:6669:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a9a7dac800 from 1 10000000:01000000:3.0:1788535779.072278:0:6669:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788535779.072315:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.072325:0:6669:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.072337:0:6669:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535779.072376:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025280:0@lo:101: 00000100:00100000:3.0:1788535779.072444:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.072481:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987efde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788535779.072824:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607025280 00000100:00100000:1.0:1788535779.072832:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607025280 00000100:00100000:1.0:1788535779.072881:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788535779.072918:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607025280:12345-0@lo:101: 00010000:00010000:1.0:1788535779.073135:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535779.073150:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981653600/0x74f51638375d37c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d37bf expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.073172:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981653600/0x74f51638375d37c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d37bf expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.073201:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981653600/0x74f51638375d37c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d37bf expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.073210:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981653600, rc 0) 00000100:00100000:1.0:1788535779.073262:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:6669:x1875415607025280:12345-0@lo:101: Request processed in 347us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.073269:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788535779.073487:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025280:0@lo:101: 00010000:00010000:0.0:1788535779.073501:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d37c6 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.073511:0:6669:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d37c6 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.073613:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025408:0@lo:501: 00000100:00100000:0.0:1788535779.073642:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.073677:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986e913c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.073731:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607025408 00000100:00100000:2.0:1788535779.073736:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607025408 00000100:00100000:2.0:1788535779.073761:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788535779.073769:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:6669:x1875415607025408:12345-0@lo:501: 00000100:00100000:0.0:1788535779.074440:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025408:0@lo:501: 00000100:00100000:0.0:1788535779.074470:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025536:0@lo:503: 00000100:00100000:0.0:1788535779.074563:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.074592:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986e913c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535779.076677:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607025536 00000100:00100000:3.0:1788535779.076694:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607025536 00000100:00100000:3.0:1788535779.076763:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788535779.076772:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:6669:x1875415607025536:12345-0@lo:503: 00000100:00100000:3.0:1788535779.077068:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:6669:x1875415607025536:12345-0@lo:503: Request processed in 297us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535779.077077:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788535779.077226:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:6669:x1875415607025408:12345-0@lo:501: Request processed in 3455us (3579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.077234:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788535779.077311:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025536:0@lo:503: 00000040:00080000:0.0:1788535779.077655:0:6669:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788535779.077725:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025664:0@lo:502: 00000100:00100000:0.0:1788535779.077769:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.077805:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986e913c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535779.077999:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607025664 00000100:00100000:3.0:1788535779.078005:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607025664 00000100:00100000:3.0:1788535779.078044:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788535779.078052:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:6669:x1875415607025664:12345-0@lo:502: 00000100:00100000:3.0:1788535779.078223:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:6669:x1875415607025664:12345-0@lo:502: Request processed in 172us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535779.078229:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788535779.083257:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025664:0@lo:502: 00000040:00080000:2.0:1788535779.084427:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788535779.084501:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788535779.084529:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788535779.084580:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788535779.084611:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788535779.084647:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788535779.084674:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788535779.084703:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788535779.084747:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788535779.084781:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788535779.084813:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788535779.084859:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788535779.085683:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788535779.085734:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788535779.085787:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788535779.085817:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788535779.085860:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788535779.086302:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788535779.086617:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788535779.086653:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788535779.086712:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788535779.086747:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788535779.086781:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788535779.086837:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788535779.086874:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788535779.091657:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788535779.091747:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788535779.091778:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788535779.091826:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025792:0@lo:502: 00000100:00100000:2.0:1788535779.092186:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.092270:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b7384d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535779.100476:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607025792 00000100:00100000:1.0:1788535779.100493:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607025792 00000100:00100000:1.0:1788535779.100617:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788535779.100629:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:6669:x1875415607025792:12345-0@lo:502: 00000100:00100000:2.0:1788535779.100997:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607025792:0@lo:502: 00000040:00080000:2.0:1788535779.101119:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788535779.101135:0:6669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788535779.101678:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788535779.101695:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97a990fa0000) 00000020:00000080:2.0:1788535779.101715:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788535779.101807:0:6694:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a9a7dac800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788535779.101811:0:6694:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a9a7dac800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788535779.101814:0:6694:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a9a7dac800 3 00010000:00080000:2.0:1788535779.101840:0:6694:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a9bf5c5800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788535779.104078:0:6694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788535779.104299:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788535779.104333:0:6694:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788535779.104348:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x74f51638375d37d4 00000100:00080000:2.0:1788535779.104359:0:6694:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788535779.104365:0:6694:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97a9bf5c5800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788535779.104402:0:6694:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b74d6300 x1875415607025920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788535779.104458:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875415607025920:0@lo:38: 00000100:00100000:2.0:1788535779.104526:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.112253:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607025920 00000100:00100000:2.0:1788535779.112268:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607025920 00000100:00080000:3.0:1788535779.112282:0:6694:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788535779.112325:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788535779.112335:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875415607025920:12345-0@lo:38: 00010000:00080000:2.0:1788535779.112464:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:2.0:1788535779.112498:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x74f51638375d37db 00000100:00100000:1.0:1788535779.112569:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:6669:x1875415607025792:12345-0@lo:502: Request processed in 11942us (20383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.112579:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788535779.112730:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607026048:0@lo:400: 00000100:00100000:3.0:1788535779.112791:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.113978:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788535779.113993:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000040:00080000:3.0:1788535779.114237:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000004:00100000:2.0:1788535779.118774:0:5834:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788535779.118834:0:5834:0:(import.c:65:import_set_state_nolock()) ffff97a9bf5c5000 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1788535779.118950:0:6669:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000100:00100000:2.0:1788535779.118952:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875415607025920:12345-0@lo:38: Request processed in 6614us (14422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.118966:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788535779.118996:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607026048 10000000:01000000:0.0:1788535779.118998:0:6669:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:2.0:1788535779.119003:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607026048 00010000:00080000:3.0:1788535779.119011:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a9b74d6300 x1875415607025920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788535789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788535779.119015:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d37c6 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.119032:0:6669:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d37c6 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535779.119044:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788535779.119047:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1788535779.119056:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607026048:12345-0@lo:400: 00000100:00080000:3.0:1788535779.119058:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788535779.119068:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788535779.119073:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788535779.119077:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a9bf5c5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788535779.119085:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875415607025920:0@lo:38: 00000100:00100000:2.0:1788535779.119106:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607026048:12345-0@lo:400: Request processed in 53us (6313us total) trans 0 rc 0/0 00000020:01000004:0.0:1788535779.119106:0:6669:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788535779.119109:0:6669:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788535779.119110:0:6669:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788535779.119111:0:6669:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788535779.119112:0:6669:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788535779.119114:0:6669:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788535779.119115:0:6669:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788535779.119117:0:6669:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788535779.119118:0:6669:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788535779.119119:0:6669:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788535779.119121:0:6669:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788535779.119124:0:6669:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788535779.119126:0:6669:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788535779.119128:0:6669:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788535779.119129:0:6669:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788535779.119130:0:6669:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788535779.119131:0:6669:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788535779.119132:0:6669:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788535779.119133:0:6669:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788535779.119134:0:6669:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788535779.119135:0:6669:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788535779.119136:0:6669:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788535779.119137:0:6669:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788535779.119155:0:6669:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788535779.119168:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607026176:0@lo:253: 00000100:00100000:2.0:1788535779.119185:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788535779.119218:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788535779.119233:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a9b74d0380 x1875415607026048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535779.119246:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607026048:0@lo:400: 00000100:00100000:0.0:1788535779.119254:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986e91e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788535779.119338:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607026176 00000100:00100000:1.0:1788535779.119344:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607026176 00000100:00100000:1.0:1788535779.119377:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788535779.119385:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:6669:x1875415607026176:12345-0@lo:253: 20000000:01000000:1.0:1788535779.119406:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788535779.119419:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788535779.175919:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788535779.175971:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788535779.176120:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788535779.176125:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788535779.176149:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.176168:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a98ab4a600/0x74f51638375d3741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d373a expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.176177:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.176216:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a98ab4a600/0x74f51638375d3741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d373a expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.176230:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a98ab4a600/0x74f51638375d3741 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d373a expref: 13 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.176244:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875415607026304:0@lo:104: 00000100:00100000:0.0:1788535779.176302:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.176358:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986e91a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.176856:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607026304 00000100:00100000:2.0:1788535779.176866:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607026304 00000100:00100000:2.0:1788535779.176939:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788535779.176948:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:5848:x1875415607026304:12345-0@lo:104: 00010000:00010000:2.0:1788535779.176962:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a9c216d400/0x74f51638375d373a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3741 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.177025:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788535779.177031:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:5848:x1875415607026304:12345-0@lo:104: Request processed in 85us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.177038:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788535779.177190:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535779.177197:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9c216d400/0x74f51638375d373a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3741 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.177205:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216d400 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:0.0:1788535779.177208:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9c216d400/0x74f51638375d373a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d3741 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.177216:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9c216d400/0x74f51638375d373a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d3741 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535779.177224:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9c216d400/0x74f51638375d373a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d3741 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535779.177245:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788535779.177283:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9c216d400/0x74f51638375d373a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3741 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.177290:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535779.177315:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9c216d400/0x74f51638375d373a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3741 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.177323:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9c216d400/0x74f51638375d373a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3741 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.177339:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535779.177341:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535779.177343:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535779.177351:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535779.177363:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607026432:0@lo:103: 00000100:00100000:0.0:1788535779.177398:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.177434:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607026432 00000100:00100000:0.0:1788535779.177438:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607026432 00010000:00010000:0.0:1788535779.177455:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a98ab4a600/0x74f51638375d3741 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d373a expref: 14 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.177921:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788535779.177932:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:3308:x1875415607026432:12345-0@lo:103: 00010000:00010000:0.0:1788535779.177942:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535779.177948:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a98ab4a600/0x74f51638375d3741 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d373a expref: 14 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.177958:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a98ab4a600/0x74f51638375d3741 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d373a expref: 14 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.177981:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.177988:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788535779.178001:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001876597s 00010000:00010000:0.0:1788535779.178006:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.178154:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4a600/0x74f51638375d3741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d373a expref: 14 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535779.178165:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875415607026304:0@lo:104: 00010000:00010000:0.0:1788535779.178198:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.178205:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.178212:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.184671:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.184691:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.184699:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.185127:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980031e00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788535779.185134:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.185146:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.185161:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.185171:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980031e00/0x74f51638375d37e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.185211:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535779.185298:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:3308:x1875415607026432:12345-0@lo:103: Request processed in 7364us (7894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.185307:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788535779.185542:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607026432:0@lo:103: 00000100:00100000:3.0:1788535779.211763:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:6669:x1875415607026176:12345-0@lo:253: Request processed in 92368us (92537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535779.211790:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788535779.211941:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:6669:1875415607026176:0@lo:253: 10000000:01000000:0.0:1788535779.211959:0:6669:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788535779.211962:0:6669:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788535779.211964:0:6669:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788535779.211966:0:6669:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788535779.211967:0:6669:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788535779.211968:0:6669:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788535779.211969:0:6669:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788535779.211971:0:6669:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788535779.211972:0:6669:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788535779.211973:0:6669:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788535779.211975:0:6669:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788535779.211977:0:6669:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788535779.211992:0:6669:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788535779.214694:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788535779.222274:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788535779.224237:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788535779.225369:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788535779.226074:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788535779.226333:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788535779.228380:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788535779.236320:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788535779.513136:0:6669:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788535779.513144:0:6669:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788535779.513176:0:6669:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788535779.513242:0:6669:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788535779.513256:0:6669:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788535779.513284:0:6669:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788535780.237995:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535781.264553:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535782.285908:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535783.310163:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535784.205712:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607026816:0@lo:400: 00000100:00100000:1.0:1788535784.205779:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535784.205859:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607026816 00000100:00100000:1.0:1788535784.205866:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607026816 00000100:00100000:1.0:1788535784.205932:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788535784.205942:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607026816:12345-0@lo:400: 00000100:00100000:1.0:1788535784.205993:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607026816:12345-0@lo:400: Request processed in 52us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535784.206001:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788535784.206023:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788535784.206050:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b74d2300 x1875415607026816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535784.206064:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607026816:0@lo:400: 00000100:00100000:3.0:1788535784.206167:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607026688:0@lo:400: 00000100:00100000:3.0:1788535784.206200:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535784.206221:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535784.206227:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607026560:0@lo:400: 00000100:00100000:3.0:1788535784.206253:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535784.206282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607026688 00000100:00100000:3.0:1788535784.206286:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607026688 00000100:00100000:3.0:1788535784.206311:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788535784.206317:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607026688:12345-0@lo:400: 00000100:00100000:3.0:1788535784.206354:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607026688:12345-0@lo:400: Request processed in 37us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535784.206360:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788535784.206392:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b74d0000 x1875415607026688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535784.206401:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607026688:0@lo:400: 00000100:00100000:1.0:1788535784.206602:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607026560 00000100:00100000:1.0:1788535784.206607:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607026560 00000100:00100000:1.0:1788535784.206643:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788535784.206651:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:3311:x1875415607026560:12345-0@lo:400: 00000100:00100000:1.0:1788535784.206688:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:3311:x1875415607026560:12345-0@lo:400: Request processed in 38us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535784.206695:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788535784.206728:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607026560:0@lo:400: 10000000:01000000:0.0:1788535784.211558:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788535784.211567:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a9ac46a000 from 21 10000000:01000000:0.0:1788535784.211573:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788535784.211626:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535784.211638:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535784.211651:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535784.211676:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607026944:0@lo:101: 00000100:00100000:0.0:1788535784.211762:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535784.211816:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987f6d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535784.212544:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607026944 00000100:00100000:2.0:1788535784.212556:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607026944 00000100:00100000:2.0:1788535784.212611:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788535784.212620:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986eda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5830:x1875415607026944:12345-0@lo:101: 00010000:00010000:2.0:1788535784.212635:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535784.212649:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9c216d400/0x74f51638375d37f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d37e9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535784.212673:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9c216d400/0x74f51638375d37f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d37e9 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535784.212683:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9c216d400/0x74f51638375d37f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d37e9 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535784.212700:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216d400, rc 0) 00000100:00100000:2.0:1788535784.212748:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986eda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:5830:x1875415607026944:12345-0@lo:101: Request processed in 130us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535784.212755:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788535784.212941:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607026944:0@lo:101: 00010000:00010000:0.0:1788535784.212958:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d37f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535784.212968:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d37f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535784.213028:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607027072:0@lo:501: 00000100:00100000:0.0:1788535784.213057:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535784.213089:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987f6d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535784.213457:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607027072 00000100:00100000:2.0:1788535784.213462:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607027072 00000100:00100000:2.0:1788535784.213499:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788535784.213507:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:5830:x1875415607027072:12345-0@lo:501: 00000100:00100000:2.0:1788535784.214242:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:5830:x1875415607027072:12345-0@lo:501: Request processed in 732us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535784.214251:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788535784.214302:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607027072:0@lo:501: 00000100:00100000:2.0:1788535784.214356:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607027200:0@lo:503: 00000100:00100000:2.0:1788535784.214399:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535784.214425:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986cc1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535784.214436:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607027200 00000100:00100000:2.0:1788535784.214440:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607027200 00000100:00100000:2.0:1788535784.214463:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788535784.214469:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:5830:x1875415607027200:12345-0@lo:503: 00000100:00100000:1.0:1788535784.217392:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607027200:0@lo:503: 00000100:00100000:2.0:1788535784.217756:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:5830:x1875415607027200:12345-0@lo:503: Request processed in 2650us (2719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535784.217769:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788535784.217882:0:6972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:6972:1875415607027328:0@lo:502: 00000100:00100000:1.0:1788535784.217967:0:6972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535784.217997:0:6972:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535784.218271:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607027328 00000100:00100000:2.0:1788535784.218279:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607027328 00000100:00100000:2.0:1788535784.218320:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788535784.218328:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:6972:x1875415607027328:12345-0@lo:502: 00000100:00100000:2.0:1788535784.219997:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:6972:x1875415607027328:12345-0@lo:502: Request processed in 1661us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535784.220010:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788535784.220278:0:6972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:6972:1875415607027328:0@lo:502: 00000100:00100000:1.0:1788535784.220345:0:6972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:6972:1875415607027456:0@lo:502: 00000100:00100000:1.0:1788535784.220392:0:6972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535784.220473:0:6972:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535784.222258:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607027456 00000100:00100000:2.0:1788535784.222271:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607027456 00000100:00100000:2.0:1788535784.222381:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788535784.222394:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:6972:x1875415607027456:12345-0@lo:502: 00000100:00100000:2.0:1788535784.222667:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:6972:x1875415607027456:12345-0@lo:502: Request processed in 276us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535784.222675:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788535784.222832:0:6972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:6972:1875415607027456:0@lo:502: 00000040:00080000:0.0:1788535784.222868:0:6972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788535784.223313:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788535784.223342:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788535784.223351:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d37f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.223363:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d37f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535784.223373:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788535784.223375:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a9ac46a000 from 4 10000000:01000000:1.0:1788535784.223378:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788535784.223411:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.223420:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.223430:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535784.223448:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607027584:0@lo:101: 00000100:00100000:1.0:1788535784.223490:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535784.224328:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535784.224403:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607027584 00000100:00100000:2.0:1788535784.224410:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607027584 00000100:00100000:2.0:1788535784.224458:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788535784.224480:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:5830:x1875415607027584:12345-0@lo:101: 00010000:00010000:2.0:1788535784.224493:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535784.224508:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9c216da00/0x74f51638375d37fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d37f7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535784.224545:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9c216da00/0x74f51638375d37fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d37f7 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535784.224556:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9c216da00/0x74f51638375d37fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d37f7 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535784.224565:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216da00, rc 0) 00000100:00100000:2.0:1788535784.224607:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607027584:12345-0@lo:101: Request processed in 130us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535784.224614:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788535784.224711:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607027584:0@lo:101: 00010000:00010000:1.0:1788535784.224724:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d37fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.224739:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d37fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535784.224790:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607027712:0@lo:256: 00000100:00100000:1.0:1788535784.224823:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535784.224847:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535784.224861:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607027712 00000100:00100000:1.0:1788535784.224865:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607027712 00000100:00100000:1.0:1788535784.225336:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788535784.225347:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607027712:12345-0@lo:256: 20000000:01000000:1.0:1788535784.225364:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788535784.225381:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788535784.225384:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788535784.225464:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607027712:12345-0@lo:256: Request processed in 121us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535784.225472:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788535784.225507:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607027712:0@lo:256: 10000000:01000000:1.0:1788535784.225559:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788535784.225566:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d37fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.225575:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d37fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535784.225583:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788535784.225585:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788535784.225587:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788535784.225614:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.225621:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.225630:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535784.225643:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607027840:0@lo:101: 00000100:00100000:1.0:1788535784.225667:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535784.225683:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535784.225753:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607027840 00000100:00100000:1.0:1788535784.225758:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607027840 00000100:00100000:1.0:1788535784.225778:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788535784.225784:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607027840:12345-0@lo:101: 00010000:00010000:1.0:1788535784.225791:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535784.225801:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981652a00/0x74f51638375d380c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3805 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.225817:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981652a00/0x74f51638375d380c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3805 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.225825:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981652a00/0x74f51638375d380c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3805 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.225832:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981652a00, rc 0) 00000100:00100000:1.0:1788535784.225861:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607027840:12345-0@lo:101: Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535784.225866:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788535784.225919:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607027840:0@lo:101: 00010000:00010000:1.0:1788535784.225930:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d380c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.225938:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d380c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535784.225979:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607027968:0@lo:501: 00000100:00100000:1.0:1788535784.226003:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535784.226016:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535784.226028:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607027968 00000100:00100000:1.0:1788535784.226031:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607027968 00000100:00100000:1.0:1788535784.226338:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788535784.226345:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607027968:12345-0@lo:501: 00000100:00100000:1.0:1788535784.226585:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607027968:12345-0@lo:501: Request processed in 239us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535784.226592:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788535784.226656:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607027968:0@lo:501: 00000100:00100000:3.0:1788535784.226703:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607028096:0@lo:503: 00000100:00100000:3.0:1788535784.227593:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535784.227641:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a882adf780 going to sleep for 11 seconds 00000100:00100000:2.0:1788535784.227725:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607028096 00000100:00100000:2.0:1788535784.227732:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607028096 00000100:00100000:2.0:1788535784.227778:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788535784.227786:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607028096:12345-0@lo:503: 00000100:00100000:2.0:1788535784.228157:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607028096:12345-0@lo:503: Request processed in 370us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535784.228164:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788535784.228487:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607028096:0@lo:503: 00000100:00100000:3.0:1788535784.228986:0:6973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:6973:1875415607028224:0@lo:502: 00000100:00100000:3.0:1788535784.229051:0:6973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535784.229082:0:6973:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a882adf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535784.230465:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607028224 00000100:00100000:2.0:1788535784.230479:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607028224 00000100:00100000:2.0:1788535784.230548:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788535784.230559:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:6973:x1875415607028224:12345-0@lo:502: 00000100:00100000:2.0:1788535784.230882:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:6973:x1875415607028224:12345-0@lo:502: Request processed in 324us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535784.230919:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788535784.231979:0:6973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:6973:1875415607028224:0@lo:502: 00000020:01000000:3.0:1788535784.232023:0:6973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788535784.232031:0:6973:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788535784.232051:0:6973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535784.232053:0:6973:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788535784.232058:0:6973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788535784.232062:0:6973:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:3.0:1788535784.232085:0:6973:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788535784.232089:0:6973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788535784.232103:0:6973:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97a986be0000) 00000020:00000080:3.0:1788535784.232124:0:6973:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788535784.232190:0:6973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788535784.232273:0:6973:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788535784.232278:0:6973:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788535784.232285:0:6973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d381a 00010000:00080000:3.0:1788535784.232317:0:6973:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a987b68800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788535784.232560:0:6973:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788535784.298063:0:6973:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788535784.298088:0:6973:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788535784.299194:0:6973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788535784.299426:0:6973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788535784.299479:0:6973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788535784.299552:0:6973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788535784.304571:0:6977:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788535784.304579:0:6977:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788535784.307534:0:6973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788535784.307549:0:6973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788535784.307598:0:6973:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788535784.307619:0:6973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74f51638375d3821 00000100:00080000:1.0:1788535784.308558:0:6973:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788535784.308567:0:6973:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97a987b68800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788535784.308607:0:6973:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b74d1c00 x1875415607028352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788535784.308643:0:6973:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788535784.308728:0:6973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535784.308735:0:6973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535784.308737:0:6973:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788535784.308741:0:6973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535784.308746:0:6973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535784.308747:0:6973:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788535784.308750:0:6973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788535784.308752:0:6973:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788535784.308780:0:6973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:6973:1875415607028480:0@lo:502: 00000100:00100000:3.0:1788535784.308788:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607028352:0@lo:8: 00000100:00100000:1.0:1788535784.308865:0:6973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535784.308867:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535784.308949:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607028480 00000100:00100000:0.0:1788535784.308958:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607028480 00000100:00100000:0.0:1788535784.309011:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788535784.309022:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:6973:x1875415607028480:12345-0@lo:502: 00000100:00100000:3.0:1788535784.309289:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607028352 00000100:00100000:3.0:1788535784.309293:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607028352 00000100:00100000:3.0:1788535784.309314:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788535784.309326:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875415607028352:12345-0@lo:8: 00010000:00080000:3.0:1788535784.309346:0:6671:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1788535784.309372:0:6671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74f51638375d3828 00002000:00100000:3.0:1788535784.309415:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97a987b6b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788535784.309420:0:6671:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788535784.309424:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788535784.309540:0:6671:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788535784.309717:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788535784.309740:0:6671:0:(import.c:65:import_set_state_nolock()) ffff97a987b6c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788535784.310975:0:6973:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987bc0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535784.312175:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:6973:x1875415607028480:12345-0@lo:502: Request processed in 3147us (3307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535784.312189:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788535784.312507:0:6973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:6973:1875415607028480:0@lo:502: 00000020:01000000:1.0:1788535784.312560:0:6973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535784.312568:0:6973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535784.312570:0:6973:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788535784.312795:0:6973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1788535784.314856:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875415607028352:12345-0@lo:8: Request processed in 5521us (5985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535784.314870:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788535784.314947:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b74d1c00 x1875415607028352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788535794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535784.314958:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788535784.314969:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000020:01000000:1.0:1788535784.315076:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788535784.315100:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788535784.315110:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d380c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.315121:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d380c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535784.315131:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788535784.315133:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97a986be19c0 from 1 10000000:01000000:1.0:1788535784.315136:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788535784.315171:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.315179:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535784.315197:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535784.315218:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607028608:0@lo:101: 00000100:00100000:1.0:1788535784.315261:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535784.315292:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a992036180 going to sleep for 11 seconds 00000100:00080000:3.0:1788535784.316339:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788535784.316350:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788535784.316354:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a987b68800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788535784.316375:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788535784.316382:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607028352:0@lo:8: 00000100:00100000:3.0:1788535784.316425:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607028608 00000100:00100000:3.0:1788535784.316432:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607028608 00000100:00100000:3.0:1788535784.316467:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788535784.316475:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607028608:12345-0@lo:101: 00010000:00010000:3.0:1788535784.316487:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535784.316507:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a98ab4bc00/0x74f51638375d3836 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d382f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535784.316953:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4bc00/0x74f51638375d3836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d382f expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535784.316965:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a98ab4bc00/0x74f51638375d3836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d382f expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535784.316974:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4bc00, rc 0) 00000100:00100000:3.0:1788535784.317035:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607028608:12345-0@lo:101: Request processed in 560us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535784.317042:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788535784.317090:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607028608:0@lo:101: 00010000:00010000:3.0:1788535784.317105:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535784.317115:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535784.317297:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607028736:0@lo:501: 00000100:00100000:3.0:1788535784.317325:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535784.317352:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a882adf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788535784.317365:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607028736 00000100:00100000:3.0:1788535784.317368:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607028736 00000100:00100000:3.0:1788535784.317387:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788535784.317393:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607028736:12345-0@lo:501: 00000100:00100000:3.0:1788535784.319277:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607028736:12345-0@lo:501: Request processed in 1874us (1942us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788535784.319309:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788535784.319372:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607028736:0@lo:501: 10000000:01000000:3.0:1788535784.319407:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788535784.319416:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535784.319426:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788535784.319450:0:6977:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788535784.319600:0:6977:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 186450711392ns, next at 0ns, rc = 0 00010000:00010000:1.0:1788535784.334555:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788535784.398781:0:6978:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788535784.398818:0:6978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875415607028992:0@lo:7: 00000100:00100000:1.0:1788535784.399157:0:6978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535784.399211:0:6978:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9920369c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535784.399240:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607028864:0@lo:13: 00000100:00100000:1.0:1788535784.399268:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535784.399312:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607028992 00000100:00100000:1.0:1788535784.399319:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607028992 00000100:00100000:1.0:1788535784.399777:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788535784.399786:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6978:x1875415607028992:12345-0@lo:7: 00000100:00100000:0.0:1788535784.401288:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607028864 00000100:00100000:0.0:1788535784.401305:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607028864 00000100:00100000:0.0:1788535784.401354:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788535784.401363:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875415607028864:12345-0@lo:13: 00002000:00000024:0.0:1788535784.401398:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788535784.401473:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875415607028864:12345-0@lo:13: Request processed in 110us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535784.401486:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788535784.404838:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788535784.404921:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b74d2a00 x1875415607028864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535784.404946:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607028864:0@lo:13: 00002000:00080000:0.0:1788535784.410432:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788535784.410441:0:6674:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788535784.410552:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6978:x1875415607028992:12345-0@lo:7: Request processed in 10763us (11392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535784.410565:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788535784.411078:0:6978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b74d1180 x1875415607028992/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788535800 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535784.411093:0:6978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875415607028992:0@lo:7: 00000004:00080000:3.0:1788535784.411107:0:6978:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788535784.411164:0:6978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875415607029120:0@lo:5: 00000100:00100000:3.0:1788535784.411209:0:6978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535784.411259:0:6978:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a882adf900 going to sleep for 11 seconds 00000100:00100000:0.0:1788535784.411401:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607029120 00000100:00100000:0.0:1788535784.411417:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607029120 00000100:00100000:0.0:1788535784.411465:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788535784.411475:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6978:x1875415607029120:12345-0@lo:5: 00002000:00080000:0.0:1788535784.411501:0:6673:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788535784.411505:0:6673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788535784.411799:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6978:x1875415607029120:12345-0@lo:5: Request processed in 324us (588us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788535784.411806:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788535784.412384:0:6978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a986aa2680 x1875415607029120/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788535800 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535784.412402:0:6978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875415607029120:0@lo:5: 00000004:00080000:3.0:1788535784.412416:0:6978:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788535784.412448:0:6978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875415607029248:0@lo:700: 00000100:00100000:3.0:1788535784.412482:0:6978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535784.412535:0:6978:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a882adf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788535784.412562:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607029248 00000100:00100000:3.0:1788535784.412566:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607029248 00000100:00100000:3.0:1788535784.412598:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788535784.412606:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6978:x1875415607029248:12345-0@lo:700: 00000100:00100000:3.0:1788535784.412634:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6680:1875415607029376:0@lo:700: 00000100:00100000:3.0:1788535784.412662:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535784.412682:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a882adfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535784.412702:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607029376 00000100:00100000:3.0:1788535784.412705:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607029376 00000100:00100000:3.0:1788535784.412731:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788535784.412738:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6680:x1875415607029376:12345-0@lo:700: 00000004:00080000:2.0:1788535784.476403:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1788535784.511071:0:5839:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788535784.521519:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6680:x1875415607029376:12345-0@lo:700: Request processed in 108762us (108836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535784.521536:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788535784.521619:0:6680:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a986aa1c00 x1875415607029376/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788535800 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535784.521635:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6680:1875415607029376:0@lo:700: 40000000:02000000:1.0:1788535784.521648:0:6680:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1788535784.603231:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788535784.603260:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788535784.603985:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6978:x1875415607029248:12345-0@lo:700: Request processed in 191373us (191495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535784.603999:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788535784.604055:0:6978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a986aa3b80 x1875415607029248/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788535800 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535784.604066:0:6978:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788535784.604082:0:6978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875415607029248:0@lo:700: 00000004:02000040:0.0:1788535784.647572:0:6978:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788535784.666561:0:6978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875415607029504:0@lo:5: 00000100:00100000:1.0:1788535784.666651:0:6978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535784.666735:0:6978:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a992036e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535784.667623:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607029504 00000100:00100000:0.0:1788535784.667635:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607029504 00000100:00100000:0.0:1788535784.667797:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788535784.668429:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6978:x1875415607029504:12345-0@lo:5: 00002000:00080000:0.0:1788535784.687749:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788535784.687773:0:6674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788535784.690421:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6978:x1875415607029504:12345-0@lo:5: Request processed in 21990us (23762us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788535784.690443:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788535784.690519:0:6978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b74d2a00 x1875415607029504/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788535800 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535784.690539:0:6978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875415607029504:0@lo:5: 00000004:00080000:0.0:1788535784.690554:0:6978:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788535785.358092:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788535785.668053:0:7043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788535786.381398:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535787.405168:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535788.429387:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535789.325245:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607029760:0@lo:400: 00000100:00100000:2.0:1788535789.325310:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535789.325359:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535789.325365:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607029632:0@lo:400: 00000100:00100000:2.0:1788535789.325393:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535789.325422:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607029888:0@lo:400: 00000100:00100000:2.0:1788535789.325445:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535789.325463:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788535789.325469:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607030016:0@lo:400: 00000100:00100000:2.0:1788535789.325509:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535789.325544:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607029760 00000100:00100000:2.0:1788535789.325550:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607029760 00000100:00100000:2.0:1788535789.325586:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607029888 00000100:00100000:2.0:1788535789.325590:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607029888 00000100:00100000:2.0:1788535789.325618:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788535789.325627:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607029760:12345-0@lo:400: 00000100:00100000:2.0:1788535789.325672:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607029760:12345-0@lo:400: Request processed in 46us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535789.325679:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788535789.325694:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788535789.325700:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607029888:12345-0@lo:400: 00000100:00100000:2.0:1788535789.325728:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607029888:12345-0@lo:400: Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535789.325734:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788535789.325758:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607029632 00000100:00100000:2.0:1788535789.325762:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607029632 00000100:00100000:2.0:1788535789.325786:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788535789.325792:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:3311:x1875415607029632:12345-0@lo:400: 00000100:00100000:2.0:1788535789.325821:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:3311:x1875415607029632:12345-0@lo:400: Request processed in 30us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535789.325827:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788535789.325857:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607030016 00000100:00100000:2.0:1788535789.325860:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607030016 00000100:00100000:2.0:1788535789.325903:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788535789.325910:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875415607030016:12345-0@lo:400: 00000100:00100000:2.0:1788535789.325939:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875415607030016:12345-0@lo:400: Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535789.325945:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788535789.325964:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535789.325967:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788535789.325998:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b74d6d80 x1875415607030016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535789.326012:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607030016:0@lo:400: 00010000:00080000:2.0:1788535789.326022:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b74d4a80 x1875415607029888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535789.326031:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607029888:0@lo:400: 00000100:00100000:2.0:1788535789.326058:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607029632:0@lo:400: 00010000:00080000:2.0:1788535789.326068:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b74d5500 x1875415607029760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535789.326076:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607029760:0@lo:400: 00010000:00010000:3.0:1788535789.453052:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535789.849175:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607030144:0@lo:13: 00000100:00100000:3.0:1788535789.849247:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535789.849394:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607030144 00000100:00100000:3.0:1788535789.849402:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607030144 00000100:00100000:3.0:1788535789.849450:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788535789.849466:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875415607030144:12345-0@lo:13: 00002000:00000024:3.0:1788535789.849510:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788535789.849556:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875415607030144:12345-0@lo:13: Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535789.849563:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788535789.849604:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b8d05f80 x1875415607030144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535789.849622:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607030144:0@lo:13: 00000001:00080000:3.0:1788535789.935738:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788535790.481220:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535791.505360:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535792.525514:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535793.551399:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535794.445416:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607030400:0@lo:400: 00000100:00100000:3.0:1788535794.445499:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535794.445567:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535794.445574:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607030528:0@lo:400: 00000100:00100000:3.0:1788535794.445599:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535794.445649:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607030400 00000100:00100000:3.0:1788535794.445656:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607030400 00000100:00100000:3.0:1788535794.445697:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607030528 00000100:00100000:3.0:1788535794.445700:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607030528 00000100:00100000:3.0:1788535794.445743:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788535794.445752:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607030400:12345-0@lo:400: 00000100:00100000:3.0:1788535794.445801:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607030400:12345-0@lo:400: Request processed in 50us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535794.445808:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788535794.445826:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788535794.445832:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607030528:12345-0@lo:400: 00000100:00100000:3.0:1788535794.445860:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607030528:12345-0@lo:400: Request processed in 29us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535794.445879:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788535794.445940:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788535794.445972:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a986aa0380 x1875415607030528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535794.445986:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607030528:0@lo:400: 00010000:00080000:3.0:1788535794.445996:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a986aa0700 x1875415607030400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535794.446016:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607030400:0@lo:400: 00000100:00100000:0.0:1788535794.446135:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607030272:0@lo:400: 00000100:00100000:0.0:1788535794.446170:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535794.446206:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788535794.446212:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607030656:0@lo:400: 00000100:00100000:0.0:1788535794.446239:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535794.446278:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607030656 00000100:00100000:0.0:1788535794.446282:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607030656 00000100:00100000:0.0:1788535794.446315:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788535794.446321:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607030656:12345-0@lo:400: 00000100:00100000:0.0:1788535794.446357:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607030656:12345-0@lo:400: Request processed in 36us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535794.446363:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788535794.446379:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788535794.446396:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a986aa1f80 x1875415607030656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535794.446404:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788535794.446415:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607030656:0@lo:400: 00000100:00100000:3.0:1788535794.448227:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607030272 00000100:00100000:3.0:1788535794.448239:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607030272 00000100:00100000:3.0:1788535794.448284:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788535794.448294:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:3311:x1875415607030272:12345-0@lo:400: 00000100:00100000:3.0:1788535794.448369:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:3311:x1875415607030272:12345-0@lo:400: Request processed in 76us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535794.448376:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788535794.448426:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607030272:0@lo:400: 00010000:00010000:3.0:1788535794.581216:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535794.959553:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788535794.959591:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607030784:0@lo:13: 00000100:00100000:2.0:1788535794.959672:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535794.959720:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607030784 00000100:00100000:0.0:1788535794.959739:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607030784 00000100:00100000:0.0:1788535794.959795:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788535794.959806:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607030784:12345-0@lo:13: 00002000:00000024:0.0:1788535794.959840:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535794.959920:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607030784:12345-0@lo:13: Request processed in 116us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535794.959928:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788535794.960551:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b8d07800 x1875415607030784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535794.960585:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607030784:0@lo:13: 00010000:00010000:2.0:1788535795.597667:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535796.623538:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788535796.669474:0:7593:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788535796.669478:0:7593:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788535796.669612:0:7593:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a986ffc800 00000020:01000004:3.0:1788535796.670085:0:7593:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788535796.670098:0:7593:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788535796.670123:0:7593:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97a9ac7a8000) 00000020:00000080:3.0:1788535796.670140:0:7593:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788535796.715331:0:7593:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788535796.715605:0:7593:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788535796.769650:0:7593:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788535796.777108:0:7593:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788535796.777143:0:7593:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788535796.777215:0:7593:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788535796.777251:0:7593:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788535796.777589:0:7593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788535796.777600:0:7593:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788535796.777609:0:7593:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x74f51638375d3844 00000020:01000004:3.0:1788535796.777617:0:7593:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788535796.777636:0:7593:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788535796.777639:0:7593:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788535796.777647:0:7593:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788535796.777665:0:7593:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788535796.777669:0:7593:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788535796.812223:0:7593:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788535796.812260:0:7593:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788535796.812264:0:7593:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788535796.812266:0:7593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788535796.812267:0:7593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788535796.812269:0:7593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788535796.812270:0:7593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788535796.812271:0:7593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788535796.812272:0:7593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788535796.812274:0:7593:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788535796.812275:0:7593:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788535796.812276:0:7593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788535796.812278:0:7593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788535796.812281:0:7593:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788535796.812284:0:7593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788535796.812285:0:7593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788535796.812286:0:7593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788535796.812288:0:7593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788535796.812289:0:7593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788535796.812290:0:7593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788535796.812291:0:7593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788535796.812292:0:7593:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788535796.812293:0:7593:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788535796.812294:0:7593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788535796.812299:0:7593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788535796.812325:0:7593:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788535796.812343:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607030912:0@lo:253: 00000100:00100000:3.0:1788535796.812408:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535796.812483:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788535796.812818:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607030912 00000100:00100000:2.0:1788535796.812826:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607030912 00000100:00100000:2.0:1788535796.812871:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788535796.812879:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:7593:x1875415607030912:12345-0@lo:253: 20000000:01000000:2.0:1788535796.812925:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788535796.812929:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788535796.812934:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788535796.812937:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788535796.813737:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788535796.813941:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788535796.813954:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788535796.813986:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788535796.813992:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788535796.814015:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788535796.814052:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788535796.814392:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788535796.814416:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:2.0:1788535796.814418:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:2.0:1788535796.814462:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788535796.814470:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788535796.814520:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788535796.814528:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:2.0:1788535796.814552:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788535796.814559:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788535796.814583:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788535796.814620:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788535796.815375:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788535796.815393:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:2.0:1788535796.815394:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:2.0:1788535796.815434:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788535796.815443:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788535796.815472:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788535796.815479:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:2.0:1788535796.815507:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788535796.815515:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788535796.815561:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788535796.815597:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788535796.815613:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788535796.815616:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788535796.815621:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788535796.815622:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788535796.815625:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788535796.815636:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788535796.815639:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788535796.815669:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788535796.815672:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788535796.818084:0:7594:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788535796.818181:0:7594:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788535796.818215:0:7594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788535796.818551:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788535796.818599:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788535796.818672:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1788535796.818686:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788535796.818688:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788535796.819364:0:7595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788535796.819412:0:7595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788535796.819630:0:7595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788535796.820791:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788535796.820855:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788535796.821628:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788535796.821654:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788535796.821658:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788535796.823545:0:7596:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788535796.823643:0:7596:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788535796.823700:0:7596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788535796.824332:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788535796.824376:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788535796.824446:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788535796.824460:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788535796.824463:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788535796.825309:0:7597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788535796.827195:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788535796.827259:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788535796.827340:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1788535796.827363:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788535796.827381:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.827398:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9c216c000/0x74f51638375d379c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3795 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.827406:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981653600/0x74f51638375d37c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d37bf expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.827413:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9c216d400/0x74f51638375d37f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d37e9 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.827420:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981652a00/0x74f51638375d380c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3805 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.827438:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a98ab4bc00/0x74f51638375d3836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d382f expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.827447:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.827488:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a98ab4bc00/0x74f51638375d3836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d382f expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.828012:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a98ab4bc00/0x74f51638375d3836 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d382f expref: 16 pid: 5826 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535796.828027:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607031040:0@lo:104: 00000100:00100000:3.0:1788535796.828089:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788535796.828192:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981652a00/0x74f51638375d380c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d3805 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.828201:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a981652a00/0x74f51638375d380c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d3805 expref: 16 pid: 5827 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535796.828210:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607031168:0@lo:104: 00010000:00010000:3.0:1788535796.828236:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9c216d400/0x74f51638375d37f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d37e9 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.828244:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a9c216d400/0x74f51638375d37f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d37e9 expref: 16 pid: 5825 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535796.828252:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607031296:0@lo:104: 00010000:00010000:3.0:1788535796.828273:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981653600/0x74f51638375d37c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d37bf expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.828281:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a981653600/0x74f51638375d37c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d37bf expref: 16 pid: 5825 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535796.828288:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607031424:0@lo:104: 00010000:00010000:3.0:1788535796.828309:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9c216c000/0x74f51638375d379c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d3795 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.828332:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a9c216c000/0x74f51638375d379c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d3795 expref: 16 pid: 5827 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535796.828340:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607031552:0@lo:104: 00000100:00100000:3.0:1788535796.828360:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788535796.828430:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788535796.828451:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535796.828482:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535796.828491:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535796.828499:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535796.830745:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607031040 00000100:00100000:1.0:1788535796.830761:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607031040 00000100:00100000:1.0:1788535796.831019:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607031168 00000100:00100000:1.0:1788535796.831025:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607031168 00000100:00100000:1.0:1788535796.831047:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607031296 00000100:00100000:1.0:1788535796.831051:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607031296 00000100:00100000:1.0:1788535796.831070:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607031424 00000100:00100000:1.0:1788535796.831073:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607031424 00000100:00100000:1.0:1788535796.831158:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607031552 00000100:00100000:1.0:1788535796.831162:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607031552 00000100:00100000:1.0:1788535796.831193:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788535796.831205:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987b63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+7:5826:x1875415607031040:12345-0@lo:104: 00010000:00010000:1.0:1788535796.831223:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.831330:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788535796.831339:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987b63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+7:5826:x1875415607031040:12345-0@lo:104: Request processed in 136us (3247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.831367:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788535796.831530:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788535796.831540:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+6:5826:x1875415607031168:12345-0@lo:104: 00010000:00010000:1.0:1788535796.831549:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d380c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.831596:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788535796.831603:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+6:5826:x1875415607031168:12345-0@lo:104: Request processed in 65us (3151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.831610:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788535796.831631:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788535796.831640:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:5826:x1875415607031296:12345-0@lo:104: 00010000:00010000:1.0:1788535796.831649:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d37f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.831760:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788535796.831766:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:5826:x1875415607031296:12345-0@lo:104: Request processed in 129us (3282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.831935:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788535796.831959:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788535796.831968:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+4:5826:x1875415607031424:12345-0@lo:104: 00010000:00010000:1.0:1788535796.831977:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d37c6 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.832015:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788535796.832022:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+4:5826:x1875415607031424:12345-0@lo:104: Request processed in 56us (3528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.832036:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788535796.832058:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788535796.832067:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:5826:x1875415607031552:12345-0@lo:104: 00010000:00010000:1.0:1788535796.832075:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d379c expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.832187:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788535796.832194:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:5826:x1875415607031552:12345-0@lo:104: Request processed in 129us (3692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.832202:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788535796.832234:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788535796.832241:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.832250:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981652c00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:1.0:1788535796.832255:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d3836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.832264:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d3836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535796.832271:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d3836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535796.832276:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535796.832322:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.832330:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535796.832635:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.832644:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a981652c00/0x74f51638375d382f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535796.832702:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607031040:0@lo:104: 00000100:00100000:0.0:1788535796.832714:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607031168:0@lo:104: 00000100:00100000:0.0:1788535796.832721:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607031296:0@lo:104: 00010000:00010000:1.0:1788535796.832727:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1788535796.832731:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607031424:0@lo:104: 00010000:00010000:1.0:1788535796.832733:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d380c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535796.832741:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875415607031552:0@lo:104: 00010000:00010000:1.0:1788535796.832743:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981653000 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:1.0:1788535796.832748:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d380c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.832756:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d380c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535796.832762:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d380c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535796.832767:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788535796.832770:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.832806:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788535796.832811:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d37f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.832830:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980030200 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:0.0:1788535796.832833:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d37f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.832841:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d37f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535796.832847:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d37f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535796.832852:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788535796.832869:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d37f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.832876:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535796.832882:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d37f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.832905:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a980030200/0x74f51638375d37e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d37f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.832917:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788535796.832920:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d37c6 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.832924:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a400 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:0.0:1788535796.832927:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d37c6 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.832942:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d37c6 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535796.832949:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d37c6 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535796.832954:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788535796.832966:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d37c6 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.832971:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535796.832986:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d37c6 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.832992:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a400/0x74f51638375d37bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d37c6 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.833001:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535796.833004:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d379c expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.833009:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216ce00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:0.0:1788535796.833011:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d379c expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.833017:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d379c expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535796.833023:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d379c expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535796.833033:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788535796.833045:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d379c expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.833051:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535796.833056:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d379c expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.833061:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d3795 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d379c expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.833072:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535796.833073:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535796.833075:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535796.833081:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535796.833092:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607031936:0@lo:103: 00000100:00100000:0.0:1788535796.833135:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535796.833185:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535796.833191:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607032064:0@lo:103: 00000100:00100000:0.0:1788535796.833212:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535796.833245:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607031936 00000100:00100000:0.0:1788535796.833251:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607031936 00010000:00010000:0.0:1788535796.833271:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981653600/0x74f51638375d37c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d37bf expref: 17 pid: 5825 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535796.833293:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607032064 00000100:00100000:0.0:1788535796.833297:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607032064 00010000:00010000:0.0:1788535796.833308:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9c216c000/0x74f51638375d379c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3795 expref: 18 pid: 5827 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535796.833335:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788535796.833342:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:3310:x1875415607031936:12345-0@lo:103: 00010000:00010000:0.0:1788535796.833353:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535796.833358:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981653600/0x74f51638375d37c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d37bf expref: 18 pid: 5825 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.833368:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981653600/0x74f51638375d37c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d37bf expref: 18 pid: 5825 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.833384:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981653600/0x74f51638375d37c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d37bf expref: 18 pid: 5825 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.833396:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535796.833436:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:3310:x1875415607031936:12345-0@lo:103: Request processed in 84us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535796.833443:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788535796.833458:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788535796.833465:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:3310:x1875415607032064:12345-0@lo:103: 00010000:00010000:0.0:1788535796.833471:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535796.833475:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9c216c000/0x74f51638375d379c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3795 expref: 16 pid: 5827 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.833483:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9c216c000/0x74f51638375d379c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d3795 expref: 16 pid: 5827 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.833493:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9c216c000/0x74f51638375d379c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d3795 expref: 16 pid: 5827 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.833513:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535796.833535:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:3310:x1875415607032064:12345-0@lo:103: Request processed in 71us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535796.833540:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788535796.833643:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d380c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.833651:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788535796.833656:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607032064:0@lo:103: 00010000:00010000:1.0:1788535796.833657:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d380c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535796.833669:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607031936:0@lo:103: 00000100:00100000:0.0:1788535796.833698:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607031680:0@lo:103: 00000100:00100000:0.0:1788535796.833722:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788535796.833742:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3805 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d380c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535796.833742:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607032192:0@lo:103: 00000100:00100000:0.0:1788535796.833769:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535796.833785:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535796.833791:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607031808:0@lo:103: 00000100:00100000:0.0:1788535796.833809:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535796.833831:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607031680 00000100:00100000:0.0:1788535796.833835:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607031680 00010000:00010000:1.0:1788535796.833848:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535796.833849:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a98ab4bc00/0x74f51638375d3836 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d382f expref: 15 pid: 5826 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.833861:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535796.833863:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607032192 00010000:00010000:1.0:1788535796.833864:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535796.833868:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607032192 00010000:00010000:0.0:1788535796.833882:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981652a00/0x74f51638375d380c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3805 expref: 16 pid: 5827 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535796.833921:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607031808 00000100:00100000:0.0:1788535796.833924:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607031808 00000100:00100000:1.0:1788535796.833932:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788535796.833938:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9c216d400/0x74f51638375d37f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d37e9 expref: 17 pid: 5825 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535796.833944:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:3308:x1875415607031680:12345-0@lo:103: 00010000:00010000:1.0:1788535796.833955:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535796.833962:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a98ab4bc00/0x74f51638375d3836 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d382f expref: 17 pid: 5826 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535796.833968:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788535796.833974:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a98ab4bc00/0x74f51638375d3836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d382f expref: 17 pid: 5826 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535796.833976:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788535796.833991:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4bc00/0x74f51638375d3836 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d382f expref: 17 pid: 5826 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535796.833996:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788535796.834002:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535796.834008:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788535796.834017:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:3308:x1875415607032192:12345-0@lo:103: 00010000:00010000:0.0:1788535796.834026:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535796.834031:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981652a00/0x74f51638375d380c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3805 expref: 16 pid: 5827 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.834043:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981652a00/0x74f51638375d380c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d3805 expref: 16 pid: 5827 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535796.834044:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:3308:x1875415607031680:12345-0@lo:103: Request processed in 101us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.834060:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788535796.834064:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981652a00/0x74f51638375d380c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d3805 expref: 16 pid: 5827 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.834076:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535796.834077:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788535796.834087:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788535796.834102:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:3308:x1875415607032192:12345-0@lo:103: Request processed in 87us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.834173:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:3308:x1875415607031808:12345-0@lo:103: 00010000:00010000:1.0:1788535796.834181:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535796.834186:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9c216d400/0x74f51638375d37f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d37e9 expref: 14 pid: 5825 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.834196:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9c216d400/0x74f51638375d37f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d37e9 expref: 14 pid: 5825 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.834207:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9c216d400/0x74f51638375d37f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d37e9 expref: 14 pid: 5825 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.834230:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.834238:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.834251:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.834258:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.834265:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.834271:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.834276:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788535796.834280:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.834288:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.834302:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.834313:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535796.834337:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:3308:x1875415607031808:12345-0@lo:103: Request processed in 167us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535796.834396:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788535796.834420:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.834438:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.834446:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4a200/0x74f51638375d384b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788535796.834460:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788535796.834468:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788535796.834504:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607031808:0@lo:103: 00000100:00100000:1.0:1788535796.834516:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607031680:0@lo:103: 00000100:00100000:1.0:1788535796.834526:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607032192:0@lo:103: 00000100:00100000:2.0:1788535796.883760:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:7593:x1875415607030912:12345-0@lo:253: Request processed in 70872us (71343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535796.883775:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788535796.883839:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607030912:0@lo:253: 10000000:01000000:2.0:1788535796.883853:0:7593:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788535796.883856:0:7593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788535796.883858:0:7593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788535796.883859:0:7593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535796.883860:0:7593:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788535796.883861:0:7593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535796.883863:0:7593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535796.883864:0:7593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788535796.883865:0:7593:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788535796.883867:0:7593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535796.883868:0:7593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788535796.883922:0:7593:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a986ffc800 from lustre-OST0001 10000000:01000000:2.0:1788535796.883945:0:7593:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788535796.883948:0:7593:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788535796.883956:0:7593:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97a986be19c0 local copy 10000000:01000000:2.0:1788535796.883960:0:7593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788535796.883997:0:7593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.884019:0:7593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.884180:0:7593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535796.884201:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607032320:0@lo:101: 00000100:00100000:2.0:1788535796.884235:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535796.884263:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788535796.884279:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607032320 00000100:00100000:2.0:1788535796.884284:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607032320 00000100:00100000:2.0:1788535796.884318:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788535796.884325:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+11:7593:x1875415607032320:12345-0@lo:101: 00010000:00010000:2.0:1788535796.884337:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535796.884349:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9c216d400/0x74f51638375d3859 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3852 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.884370:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9c216d400/0x74f51638375d3859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3852 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.884381:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9c216d400/0x74f51638375d3859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3852 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.884389:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216d400, rc 0) 00000100:00100000:2.0:1788535796.884415:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:7593:x1875415607032320:12345-0@lo:101: Request processed in 91us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535796.884421:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788535796.884464:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607032320:0@lo:101: 00010000:00010000:2.0:1788535796.884482:0:7593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x74f51638375d3859 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.884490:0:7593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x74f51638375d3859 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535796.884586:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607032448:0@lo:501: 00000100:00100000:2.0:1788535796.884609:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535796.884621:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788535796.884633:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607032448 00000100:00100000:2.0:1788535796.884636:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607032448 00000100:00100000:2.0:1788535796.884653:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788535796.884658:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:7593:x1875415607032448:12345-0@lo:501: 00000100:00100000:2.0:1788535796.884817:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:7593:x1875415607032448:12345-0@lo:501: Request processed in 158us (206us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788535796.884823:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788535796.884850:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607032448:0@lo:501: 10000000:01000000:2.0:1788535796.884859:0:7593:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788535796.884880:0:7593:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788535796.885212:0:7593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x74f51638375d3859 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.885224:0:7593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x74f51638375d3859 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.885232:0:7593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x74f51638375d3859 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.885301:0:7593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788535796.885320:0:7593:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a986ffc800 10000000:01000000:2.0:1788535796.885325:0:7593:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788535796.885329:0:7593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788535796.885331:0:7593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788535796.885335:0:7593:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788535796.885337:0:7593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788535796.885356:0:7593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.885363:0:7593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.885370:0:7593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535796.885383:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607032576:0@lo:101: 00000100:00100000:2.0:1788535796.885413:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535796.885451:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788535796.885558:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607032576 00000100:00100000:1.0:1788535796.885564:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607032576 00000100:00100000:1.0:1788535796.885599:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788535796.885606:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:7593:x1875415607032576:12345-0@lo:101: 00010000:00010000:1.0:1788535796.885614:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535796.885624:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981653000/0x74f51638375d3867 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3860 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.885641:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981653000/0x74f51638375d3867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3860 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.885650:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981653000/0x74f51638375d3867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3860 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.885657:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981653000, rc 0) 00000100:00100000:1.0:1788535796.885735:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:7593:x1875415607032576:12345-0@lo:101: Request processed in 129us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.885741:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:0.0:1788535796.889152:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535796.889166:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x74f51638375d3859 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.889177:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216de00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:0.0:1788535796.889181:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x74f51638375d3859 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.889191:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x74f51638375d3859 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535796.889198:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x74f51638375d3859 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535796.889204:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535796.889339:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74f51638375d3859 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.889347:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535796.889379:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74f51638375d3859 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.889397:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9c216de00/0x74f51638375d3852 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74f51638375d3859 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.889412:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535796.889414:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535796.889417:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535796.889477:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788535796.889497:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607032704:0@lo:103: 00000100:00100000:2.0:1788535796.889559:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535796.889652:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607032704 00000100:00100000:1.0:1788535796.889660:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607032704 00000100:00100000:1.0:1788535796.889709:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788535796.889718:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:3308:x1875415607032704:12345-0@lo:103: 00010000:00010000:1.0:1788535796.889729:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535796.889744:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9c216d400/0x74f51638375d3859 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d3852 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.889756:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535796.889792:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:3308:x1875415607032704:12345-0@lo:103: Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.889799:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788535796.889832:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607032704:0@lo:103: 00000100:00100000:3.0:1788535796.890772:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607032576:0@lo:101: 00010000:00010000:3.0:1788535796.890795:0:7593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3867 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.890805:0:7593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3867 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535796.891003:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607032832:0@lo:501: 00000100:00100000:1.0:1788535796.891054:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535796.891094:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985529e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535796.891993:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607032832 00000100:00100000:3.0:1788535796.892003:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607032832 00000100:00100000:3.0:1788535796.892059:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788535796.892068:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:7593:x1875415607032832:12345-0@lo:501: 00000100:00100000:3.0:1788535796.892365:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:7593:x1875415607032832:12345-0@lo:501: Request processed in 293us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535796.892373:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788535796.893432:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607032832:0@lo:501: 00000100:00100000:2.0:1788535796.893490:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607032960:0@lo:503: 00000100:00100000:2.0:1788535796.893544:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535796.893586:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535796.893658:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607032960 00000100:00100000:1.0:1788535796.893664:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607032960 00000100:00100000:1.0:1788535796.893705:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788535796.893712:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:7593:x1875415607032960:12345-0@lo:503: 00000100:00100000:1.0:1788535796.893916:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:7593:x1875415607032960:12345-0@lo:503: Request processed in 174us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.893924:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788535796.895300:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607032960:0@lo:503: 00000040:00080000:2.0:1788535796.898383:0:7593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788535796.898767:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033088:0@lo:502: 00000100:00100000:2.0:1788535796.898849:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535796.899081:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535796.899318:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607033088 00000100:00100000:1.0:1788535796.899327:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607033088 00000100:00100000:1.0:1788535796.899412:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788535796.899458:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:7593:x1875415607033088:12345-0@lo:502: 00000100:00100000:1.0:1788535796.899682:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:7593:x1875415607033088:12345-0@lo:502: Request processed in 260us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.899690:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788535796.899770:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033088:0@lo:502: 00000040:00080000:2.0:1788535796.900075:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788535796.900121:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788535796.900147:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788535796.900183:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788535796.900215:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788535796.900243:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788535796.900273:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033216:0@lo:502: 00000100:00100000:2.0:1788535796.900317:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535796.900668:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535796.900743:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607033216 00000100:00100000:3.0:1788535796.900749:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607033216 00000100:00100000:3.0:1788535796.900780:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788535796.900787:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:7593:x1875415607033216:12345-0@lo:502: 00000100:00100000:3.0:1788535796.901001:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:7593:x1875415607033216:12345-0@lo:502: Request processed in 214us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535796.901008:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788535796.901216:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033216:0@lo:502: 00000040:00080000:2.0:1788535796.901313:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788535796.901323:0:7593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788535796.901823:0:7600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788535796.901831:0:7600:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788535796.901837:0:7600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535796.901839:0:7600:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788535796.901843:0:7600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788535796.901865:0:7600:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97a9b713b380) 00000020:00000080:2.0:1788535796.901919:0:7600:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788535796.901927:0:7600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788535796.901979:0:7600:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a986ffc800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788535796.901985:0:7600:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788535796.901994:0:7600:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x74f51638375d3875 00010000:00010000:2.0:1788535796.905012:0:7600:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788535796.905318:0:7600:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788535796.909158:0:7600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788535796.909534:0:7600:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788535796.915441:0:7600:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788535796.917844:0:7600:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788535796.919828:0:7600:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788535796.919841:0:7600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535796.919848:0:7600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535796.919850:0:7600:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788535796.919854:0:7600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535796.919859:0:7600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535796.919861:0:7600:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788535796.919864:0:7600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788535796.919866:0:7600:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788535796.919970:0:7600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535796.919974:0:7600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535796.919975:0:7600:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788535796.919978:0:7600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788535796.920269:0:7593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788535796.920313:0:7593:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788535796.920336:0:7593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3867 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.920349:0:7593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3867 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535796.920357:0:7593:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a986ffc800 from 1 10000000:01000000:2.0:1788535796.920360:0:7593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788535796.920395:0:7593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.920402:0:7593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535796.920412:0:7593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535796.920442:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033344:0@lo:101: 00000100:00100000:2.0:1788535796.920503:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535796.920543:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788535796.920698:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607033344 00000100:00100000:1.0:1788535796.920706:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607033344 00000100:00100000:1.0:1788535796.920749:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788535796.920766:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:7593:x1875415607033344:12345-0@lo:101: 00010000:00010000:1.0:1788535796.920778:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535796.920789:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981652c00/0x74f51638375d3883 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d387c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.920808:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981652c00/0x74f51638375d3883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d387c expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.920819:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981652c00/0x74f51638375d3883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d387c expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.920826:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981652c00, rc 0) 00000100:00100000:1.0:1788535796.920862:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:7593:x1875415607033344:12345-0@lo:101: Request processed in 99us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.920868:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788535796.920948:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033344:0@lo:101: 00010000:00010000:1.0:1788535796.920962:0:7593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3883 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.920970:0:7593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3883 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535796.921279:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033472:0@lo:501: 00000100:00100000:1.0:1788535796.921308:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535796.921337:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985529c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535796.921388:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607033472 00000100:00100000:0.0:1788535796.921393:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607033472 00000100:00100000:0.0:1788535796.921436:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788535796.921444:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:7593:x1875415607033472:12345-0@lo:501: 00000100:00100000:0.0:1788535796.921651:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:7593:x1875415607033472:12345-0@lo:501: Request processed in 208us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535796.921658:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788535796.921796:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033472:0@lo:501: 00000100:00100000:1.0:1788535796.921824:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033600:0@lo:503: 00000100:00100000:1.0:1788535796.921866:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535796.921916:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985529c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535796.922006:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607033600 00000100:00100000:0.0:1788535796.922011:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607033600 00000100:00100000:0.0:1788535796.922047:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788535796.922054:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:7593:x1875415607033600:12345-0@lo:503: 00000100:00100000:0.0:1788535796.922335:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:7593:x1875415607033600:12345-0@lo:503: Request processed in 281us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535796.922351:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788535796.922641:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033600:0@lo:503: 00000040:00080000:1.0:1788535796.923078:0:7593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788535796.923136:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033728:0@lo:502: 00000100:00100000:1.0:1788535796.923176:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535796.923199:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985529c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535796.923291:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607033728 00000100:00100000:2.0:1788535796.923297:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607033728 00000100:00100000:2.0:1788535796.923334:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788535796.923342:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:7593:x1875415607033728:12345-0@lo:502: 00000100:00100000:2.0:1788535796.923515:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:7593:x1875415607033728:12345-0@lo:502: Request processed in 173us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535796.923522:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788535796.923676:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033728:0@lo:502: 00000040:00080000:1.0:1788535796.924145:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788535796.924193:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788535796.924219:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033856:0@lo:502: 00000100:00100000:1.0:1788535796.924256:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535796.924475:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985529c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535796.932051:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607033856 00000100:00100000:2.0:1788535796.932067:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607033856 00000100:00100000:2.0:1788535796.932198:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788535796.932210:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:7593:x1875415607033856:12345-0@lo:502: 00000100:00100000:2.0:1788535796.932478:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:7593:x1875415607033856:12345-0@lo:502: Request processed in 271us (8220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535796.932485:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788535796.932597:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033856:0@lo:502: 00000040:00080000:0.0:1788535796.932747:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788535796.932763:0:7593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788535796.940505:0:7604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535796.940519:0:7604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535796.940521:0:7604:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788535796.940527:0:7604:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a986ffc800 00000020:00000080:1.0:1788535796.940530:0:7604:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788535796.940550:0:7604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535796.940553:0:7604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535796.940555:0:7604:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788535796.940558:0:7604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788535796.940685:0:7593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788535796.940713:0:7593:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788535796.940736:0:7593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3883 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.940749:0:7593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3883 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535796.940788:0:7593:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788535796.940791:0:7593:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a986ffc800 10000000:01000000:3.0:1788535796.940794:0:7593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a986ffc800 10000000:01000000:3.0:1788535796.940798:0:7593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788535796.940804:0:7593:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a986ffc800 from 1 10000000:01000000:3.0:1788535796.940807:0:7593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788535796.940842:0:7593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.940851:0:7593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.940860:0:7593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535796.940917:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033984:0@lo:101: 00000100:00100000:3.0:1788535796.940976:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535796.941012:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535796.941183:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607033984 00000100:00100000:0.0:1788535796.941191:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607033984 00000100:00100000:0.0:1788535796.941240:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788535796.941249:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:7593:x1875415607033984:12345-0@lo:101: 00010000:00010000:0.0:1788535796.941261:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535796.941282:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a980030200/0x74f51638375d3891 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d388a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.941304:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980030200/0x74f51638375d3891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d388a expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.941316:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a980030200/0x74f51638375d3891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d388a expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535796.941324:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980030200, rc 0) 00000100:00100000:0.0:1788535796.941361:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7593:x1875415607033984:12345-0@lo:101: Request processed in 113us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535796.941367:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788535796.943215:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607033984:0@lo:101: 00010000:00010000:3.0:1788535796.943240:0:7593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3891 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535796.943268:0:7593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3891 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535796.943399:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607034112:0@lo:501: 00000100:00100000:3.0:1788535796.943457:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535796.943497:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788535796.943520:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607034112 00000100:00100000:3.0:1788535796.943526:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607034112 00000100:00100000:3.0:1788535796.943573:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788535796.943581:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7593:x1875415607034112:12345-0@lo:501: 00000100:00100000:3.0:1788535796.943808:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7593:x1875415607034112:12345-0@lo:501: Request processed in 228us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535796.943817:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788535796.943847:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607034112:0@lo:501: 00000100:00100000:3.0:1788535796.944345:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607034240:0@lo:503: 00000100:00100000:3.0:1788535796.944390:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535796.944689:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788535796.944709:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607034240 00000100:00100000:3.0:1788535796.944714:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607034240 00000100:00100000:1.0:1788535796.949131:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788535796.949154:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7593:x1875415607034240:12345-0@lo:503: 00000100:00100000:1.0:1788535796.949415:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7593:x1875415607034240:12345-0@lo:503: Request processed in 272us (5023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.949433:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788535796.950526:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607034240:0@lo:503: 00000040:00080000:2.0:1788535796.950813:0:7593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788535796.950937:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607034368:0@lo:502: 00000100:00100000:2.0:1788535796.950995:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535796.951038:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535796.951234:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607034368 00000100:00100000:0.0:1788535796.951241:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607034368 00000100:00100000:0.0:1788535796.951297:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788535796.951306:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7593:x1875415607034368:12345-0@lo:502: 00000100:00100000:0.0:1788535796.951520:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7593:x1875415607034368:12345-0@lo:502: Request processed in 215us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535796.951535:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788535796.951936:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607034368:0@lo:502: 00000040:00080000:2.0:1788535796.952167:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788535796.952210:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788535796.952238:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788535796.952287:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788535796.952335:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788535796.952398:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788535796.952446:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788535796.952484:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788535796.952531:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788535796.952568:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788535796.952598:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788535796.952653:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788535796.952693:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788535796.952738:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788535796.952797:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788535796.952834:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788535796.952862:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788535796.952924:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788535796.952963:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788535796.952991:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788535796.953030:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788535796.953058:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788535796.953086:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788535796.953135:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788535796.953171:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788535796.953204:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788535796.953250:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788535796.953282:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788535796.953313:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788535796.953373:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788535796.953408:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788535796.953452:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788535796.953485:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788535796.953530:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788535796.953565:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788535796.953609:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788535796.953643:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788535796.953682:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607034496:0@lo:502: 00000100:00100000:2.0:1788535796.953743:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535796.953784:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535796.953811:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607034496 00000100:00100000:2.0:1788535796.953817:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607034496 00000100:00100000:2.0:1788535796.953851:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788535796.953858:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7593:x1875415607034496:12345-0@lo:502: 00000100:00100000:2.0:1788535796.954057:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7593:x1875415607034496:12345-0@lo:502: Request processed in 198us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535796.954065:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788535796.954466:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607034496:0@lo:502: 00000040:00080000:1.0:1788535796.955040:0:7593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788535796.955055:0:7593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788535796.957268:0:7605:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788535796.957296:0:7605:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97a9b91d19c0) 00000020:00000080:0.0:1788535796.957318:0:7605:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788535796.957395:0:7605:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a986ffc800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788535796.957399:0:7605:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a986ffc800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788535796.957401:0:7605:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a986ffc800 3 00010000:00080000:0.0:1788535796.957439:0:7605:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a9ac7b6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788535796.961144:0:7605:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788535796.962199:0:7605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788535796.962238:0:7605:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788535796.962250:0:7605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x74f51638375d389f 00000100:00080000:0.0:1788535796.962260:0:7605:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788535796.962266:0:7605:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97a9ac7b6800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788535796.963058:0:7605:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b8d05f80 x1875415607034624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788535796.963118:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875415607034624:0@lo:38: 00000100:00100000:1.0:1788535796.963183:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788535796.963441:0:7605:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788535796.965560:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607034624 00000100:00100000:0.0:1788535796.965573:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607034624 00000100:00100000:2.0:1788535796.965639:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607034752:0@lo:400: 00000100:00100000:2.0:1788535796.965708:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535796.968554:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607035008:0@lo:400: 00000100:00100000:1.0:1788535796.968622:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535796.968674:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607035008 00000100:00100000:1.0:1788535796.968680:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607035008 00000100:00100000:1.0:1788535796.968732:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788535796.968742:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607035008:12345-0@lo:400: 00000100:00100000:1.0:1788535796.968789:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607035008:12345-0@lo:400: Request processed in 50us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535796.968797:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788535796.968817:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788535796.968844:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b8d04000 x1875415607035008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535796.968857:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607035008:0@lo:400: 00000100:00100000:1.0:1788535796.970067:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607034880:0@lo:400: 00000100:00100000:1.0:1788535796.971023:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535796.971166:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607034752 00000100:00100000:0.0:1788535796.971174:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607034752 00000100:00100000:0.0:1788535796.971219:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788535796.971227:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607034752:12345-0@lo:400: 00000100:00100000:3.0:1788535796.971372:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788535796.971378:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875415607034624:12345-0@lo:38: 00010000:00080000:3.0:1788535796.971399:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:3.0:1788535796.971457:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x74f51638375d38a6 00000004:00100000:3.0:1788535796.971472:0:5833:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788535796.971503:0:5833:0:(import.c:65:import_set_state_nolock()) ffff97a9bf156000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788535796.971555:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875415607034624:12345-0@lo:38: Request processed in 175us (8371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535796.971561:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788535796.972399:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607034752:12345-0@lo:400: Request processed in 1170us (6688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535796.972409:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788535796.972771:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b8d04700 x1875415607034752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535796.972786:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607034752:0@lo:400: 00010000:00080000:2.0:1788535796.973084:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b8d05f80 x1875415607034624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788535806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535796.973094:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788535796.973103:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788535796.973110:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788535796.973115:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788535796.973118:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a9ac7b6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788535796.973123:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875415607034624:0@lo:38: 00000100:00100000:2.0:1788535796.973808:0:7607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7607:1875415607035136:0@lo:901: 00000100:00100000:2.0:1788535796.973859:0:7607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535796.973935:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607035136 00000100:00100000:2.0:1788535796.973940:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607035136 00000100:00100000:2.0:1788535796.973985:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788535796.973997:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7607:x1875415607035136:12345-0@lo:901: 00000100:00100000:2.0:1788535796.974358:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7607:x1875415607035136:12345-0@lo:901: Request processed in 364us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535796.974366:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788535796.974387:0:7607:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c0c0 going to sleep for 11 seconds 00010000:00080000:2.0:1788535796.974402:0:7607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b74d6a00 x1875415607035136/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788535812 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535796.974413:0:7607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7607:1875415607035136:0@lo:901: 00000100:00080000:1.0:1788535796.977240:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535796.977385:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607034880 00000100:00100000:3.0:1788535796.977393:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607034880 00000100:00100000:3.0:1788535796.977471:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788535796.977481:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607034880:12345-0@lo:400: 00000100:00100000:3.0:1788535796.977549:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607034880:12345-0@lo:400: Request processed in 70us (6528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535796.977557:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788535796.977686:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788535796.977716:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b8d07100 x1875415607034880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535796.977730:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607034880:0@lo:400: 00000040:00080000:0.0:1788535796.978384:0:7605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788535796.978547:0:7593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788535796.978585:0:7593:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788535796.978632:0:7593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3891 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535796.978644:0:7593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3891 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788535796.978686:0:7593:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788535796.978689:0:7593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788535796.978690:0:7593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788535796.978691:0:7593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788535796.978693:0:7593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788535796.978694:0:7593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788535796.978695:0:7593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788535796.978697:0:7593:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788535796.978698:0:7593:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788535796.978700:0:7593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788535796.978701:0:7593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788535796.978705:0:7593:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788535796.978707:0:7593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788535796.978708:0:7593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788535796.978710:0:7593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788535796.978711:0:7593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788535796.978712:0:7593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788535796.978713:0:7593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788535796.978714:0:7593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788535796.978715:0:7593:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788535796.978716:0:7593:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788535796.978717:0:7593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788535796.978718:0:7593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788535796.978737:0:7593:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788535796.978750:0:7593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607035264:0@lo:253: 00000100:00100000:1.0:1788535796.978794:0:7593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535796.978860:0:7593:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a997579d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535796.979109:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607035264 00000100:00100000:2.0:1788535796.979116:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607035264 00000100:00100000:2.0:1788535796.979182:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788535796.979190:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7593:x1875415607035264:12345-0@lo:253: 20000000:01000000:2.0:1788535796.979225:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788535796.979239:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788535797.004831:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788535797.004852:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788535797.006398:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788535797.006419:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788535797.006449:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.006467:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9c216da00/0x74f51638375d37fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d37f7 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.006476:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.006513:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9c216da00/0x74f51638375d37fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d37f7 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.006526:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a9c216da00/0x74f51638375d37fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d37f7 expref: 14 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535797.006539:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875415607035392:0@lo:104: 00000100:00100000:0.0:1788535797.006598:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535797.006634:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987efda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535797.006656:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607035392 00000100:00100000:0.0:1788535797.006663:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607035392 00000100:00100000:0.0:1788535797.006701:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788535797.006709:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:5848:x1875415607035392:12345-0@lo:104: 00010000:00010000:0.0:1788535797.006722:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d37fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.006761:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788535797.006767:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:5848:x1875415607035392:12345-0@lo:104: Request processed in 58us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535797.006773:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788535797.006816:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875415607035392:0@lo:104: 00010000:00010000:0.0:1788535797.006834:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.006849:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535797.006854:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d37fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.006861:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981653200 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:0.0:1788535797.006865:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d37fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.006885:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d37fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535797.006920:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d37fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535797.006926:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788535797.006951:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d37fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.006958:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535797.006974:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d37fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.006981:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a981653200/0x74f51638375d37f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d37fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.006995:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535797.006997:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535797.007004:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535797.007023:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607035520:0@lo:103: 00000100:00100000:0.0:1788535797.007056:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535797.007092:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607035520 00000100:00100000:0.0:1788535797.007096:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607035520 00010000:00010000:0.0:1788535797.007111:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9c216da00/0x74f51638375d37fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d37f7 expref: 15 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535797.007131:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788535797.007136:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987ece450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:3309:x1875415607035520:12345-0@lo:103: 00010000:00010000:0.0:1788535797.007145:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535797.007149:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9c216da00/0x74f51638375d37fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d37f7 expref: 15 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.007159:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9c216da00/0x74f51638375d37fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d37f7 expref: 15 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.007171:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9c216da00/0x74f51638375d37fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d37f7 expref: 15 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.007183:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.007191:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788535797.007202:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001876597s 00010000:00010000:0.0:1788535797.007206:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.007213:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.007224:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.007231:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.007236:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980031400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788535797.007240:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.007248:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.007260:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.007268:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535797.007290:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987ece450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:3309:x1875415607035520:12345-0@lo:103: Request processed in 153us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535797.007296:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788535797.007331:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.007338:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535797.007345:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980031400/0x74f51638375d38ad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535797.007365:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607035520:0@lo:103: 00000100:00100000:0.0:1788535797.013734:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:7593:x1875415607035264:12345-0@lo:253: Request processed in 34534us (34929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535797.013748:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788535797.013831:0:7593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea5d41c9-12b3-443f-877d-8b3d703772fc:7593:1875415607035264:0@lo:253: 10000000:01000000:1.0:1788535797.013845:0:7593:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788535797.013862:0:7593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788535797.013863:0:7593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788535797.014031:0:7593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788535797.014033:0:7593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788535797.014034:0:7593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788535797.014035:0:7593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788535797.014037:0:7593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788535797.014038:0:7593:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788535797.014039:0:7593:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788535797.014041:0:7593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788535797.014043:0:7593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788535797.014057:0:7593:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788535797.018677:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788535797.018839:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788535797.019138:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788535797.019440:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788535797.019646:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788535797.019866:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788535797.023785:0:7593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788535797.223343:0:7593:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788535797.223350:0:7593:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788535797.223381:0:7593:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788535797.223446:0:7593:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788535797.223460:0:7593:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788535797.223485:0:7593:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788535797.645009:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535798.671866:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535799.694648:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535800.080363:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535800.080390:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607035648:0@lo:13: 00000100:00100000:1.0:1788535800.080468:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535800.080600:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607035648 00000100:00100000:0.0:1788535800.080608:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607035648 00000100:00100000:0.0:1788535800.080672:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788535800.080682:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607035648:12345-0@lo:13: 00002000:00000024:0.0:1788535800.080715:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535800.080761:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607035648:12345-0@lo:13: Request processed in 81us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535800.080768:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788535800.080810:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d04380 x1875415607035648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535800.080828:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607035648:0@lo:13: 00000100:00080000:1.0:1788535800.081240:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788535800.719288:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535801.740982:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535802.125217:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607035776:0@lo:400: 00000100:00100000:2.0:1788535802.125416:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607036160:0@lo:400: 00000100:00100000:0.0:1788535802.128168:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535802.128256:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607036288:0@lo:400: 00000100:00100000:0.0:1788535802.128315:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535802.128374:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607035904:0@lo:400: 00000100:00100000:0.0:1788535802.128407:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535802.128430:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535802.128437:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607036032:0@lo:400: 00000100:00100000:0.0:1788535802.128461:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535802.128471:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607035776 00000100:00100000:1.0:1788535802.128480:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607035776 00000100:00100000:1.0:1788535802.128532:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788535802.128541:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:3311:x1875415607035776:12345-0@lo:400: 00000100:00100000:0.0:1788535802.128562:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607036288 00000100:00100000:0.0:1788535802.128567:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607036288 00000100:00100000:1.0:1788535802.128604:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:3311:x1875415607035776:12345-0@lo:400: Request processed in 54us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535802.128607:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607035904 00000100:00100000:0.0:1788535802.128610:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607035904 00000100:00100000:0.0:1788535802.128621:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607036032 00000100:00100000:1.0:1788535802.128623:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788535802.128623:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607036032 00000100:00100000:0.0:1788535802.128639:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788535802.128645:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607036288:12345-0@lo:400: 00000100:00080000:1.0:1788535802.128659:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535802.128685:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607035776:0@lo:400: 00000100:00100000:2.0:1788535802.128708:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535802.128977:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607036288:12345-0@lo:400: Request processed in 331us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535802.128984:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788535802.128999:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788535802.129007:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607035904:12345-0@lo:400: 00000100:00100000:0.0:1788535802.129041:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607035904:12345-0@lo:400: Request processed in 36us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535802.129047:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788535802.129299:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788535802.129308:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607036032:12345-0@lo:400: 00000100:00100000:0.0:1788535802.129338:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607036032:12345-0@lo:400: Request processed in 33us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535802.129344:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788535802.129465:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d06300 x1875415607036032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535802.129478:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607036032:0@lo:400: 00010000:00080000:0.0:1788535802.129599:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d05880 x1875415607035904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535802.129609:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607035904:0@lo:400: 00010000:00080000:1.0:1788535802.134598:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d05500 x1875415607036288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535802.134618:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607036288:0@lo:400: 00000100:00100000:2.0:1788535802.134928:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607036160 00000100:00100000:2.0:1788535802.134937:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607036160 00000100:00100000:2.0:1788535802.135078:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788535802.135089:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607036160:12345-0@lo:400: 00000100:00100000:2.0:1788535802.135162:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607036160:12345-0@lo:400: Request processed in 75us (9710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535802.135169:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788535802.135205:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d05180 x1875415607036160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535802.135216:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607036160:0@lo:400: 00000100:00080000:1.0:1788535802.135696:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788535802.767419:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788535802.809703:0:7948:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1788535803.661157:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788535803.661165:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a9a7dac800 from 30 10000000:01000000:0.0:1788535803.661170:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788535803.661210:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535803.661221:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535803.661232:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535803.661258:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607036416:0@lo:101: 00000100:00100000:0.0:1788535803.661320:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535803.661370:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99cbd0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535803.661436:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607036416 00000100:00100000:2.0:1788535803.661444:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607036416 00000100:00100000:2.0:1788535803.661500:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788535803.661540:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:5830:x1875415607036416:12345-0@lo:101: 00010000:00010000:2.0:1788535803.661558:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535803.661569:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9c216ca00/0x74f51638375d38bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d38b4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535803.661596:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9c216ca00/0x74f51638375d38bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d38b4 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535803.661606:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9c216ca00/0x74f51638375d38bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d38b4 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535803.661614:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216ca00, rc 0) 00000100:00100000:2.0:1788535803.661656:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607036416:12345-0@lo:101: Request processed in 119us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535803.661663:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788535803.661914:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607036416:0@lo:101: 00010000:00010000:3.0:1788535803.661938:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535803.661948:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d38bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535803.662003:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607036544:0@lo:501: 00000100:00100000:3.0:1788535803.662036:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535803.662068:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9975793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535803.662073:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607036544 00000100:00100000:0.0:1788535803.662080:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607036544 00000100:00100000:0.0:1788535803.662117:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788535803.662124:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607036544:12345-0@lo:501: 00000100:00100000:0.0:1788535803.662389:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607036544:12345-0@lo:501: Request processed in 264us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535803.662396:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788535803.662428:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607036544:0@lo:501: 00000100:00100000:0.0:1788535803.662456:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607036672:0@lo:503: 00000100:00100000:0.0:1788535803.662492:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535803.662507:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99cbd0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535803.662519:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607036672 00000100:00100000:0.0:1788535803.662523:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607036672 00000100:00100000:0.0:1788535803.662544:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788535803.662558:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607036672:12345-0@lo:503: 00000100:00100000:0.0:1788535803.662757:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607036672:12345-0@lo:503: Request processed in 200us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535803.662765:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788535803.662807:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607036672:0@lo:503: 00000100:00100000:0.0:1788535803.663700:0:7991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:7991:1875415607036800:0@lo:502: 00000100:00100000:0.0:1788535803.663751:0:7991:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535803.663933:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607036800 00000100:00100000:3.0:1788535803.663940:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607036800 00000100:00100000:3.0:1788535803.663981:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788535803.663988:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7991:x1875415607036800:12345-0@lo:502: 00000100:00100000:3.0:1788535803.664205:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7991:x1875415607036800:12345-0@lo:502: Request processed in 216us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535803.664214:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788535803.664456:0:7991:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99cbd06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535803.664476:0:7991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:7991:1875415607036800:0@lo:502: 00000100:00100000:0.0:1788535803.664524:0:7991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:7991:1875415607036928:0@lo:502: 00000100:00100000:0.0:1788535803.664555:0:7991:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535803.664581:0:7991:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987efd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535803.664636:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607036928 00000100:00100000:3.0:1788535803.664642:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607036928 00000100:00100000:3.0:1788535803.664679:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788535803.664688:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7991:x1875415607036928:12345-0@lo:502: 00000100:00100000:3.0:1788535803.664859:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:7991:x1875415607036928:12345-0@lo:502: Request processed in 172us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535803.664867:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788535803.665253:0:7991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:7991:1875415607036928:0@lo:502: 00000040:00080000:1.0:1788535803.665277:0:7991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788535803.674368:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788535803.674417:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788535803.674429:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535803.674442:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535803.674452:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788535803.674455:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788535803.674458:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788535803.674561:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535803.674571:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535803.674582:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535803.674607:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607037056:0@lo:101: 00000100:00100000:3.0:1788535803.674671:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535803.674987:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9975793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535803.675021:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607037056 00000100:00100000:3.0:1788535803.675029:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607037056 00000100:00100000:3.0:1788535803.675074:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788535803.675084:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607037056:12345-0@lo:101: 00010000:00010000:3.0:1788535803.675096:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535803.675109:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a98ab4b800/0x74f51638375d38c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d38c2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535803.675145:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4b800/0x74f51638375d38c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d38c2 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535803.675155:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a98ab4b800/0x74f51638375d38c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d38c2 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535803.675163:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b800, rc 0) 00000100:00100000:3.0:1788535803.675203:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607037056:12345-0@lo:101: Request processed in 121us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535803.675210:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788535803.675269:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607037056:0@lo:101: 00010000:00010000:3.0:1788535803.675284:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535803.675293:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d38c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535803.675347:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607037184:0@lo:501: 00000100:00100000:3.0:1788535803.675386:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535803.675403:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535803.675420:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607037184 00000100:00100000:3.0:1788535803.675429:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607037184 00000100:00100000:3.0:1788535803.675452:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788535803.675458:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607037184:12345-0@lo:501: 00000100:00100000:2.0:1788535803.680338:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607037184:12345-0@lo:501: Request processed in 4870us (4952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535803.680351:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788535803.681516:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607037184:0@lo:501: 00000100:00100000:3.0:1788535803.681575:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607037312:0@lo:503: 00000100:00100000:3.0:1788535803.681630:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535803.681677:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535803.682527:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607037312 00000100:00100000:1.0:1788535803.682546:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607037312 00000100:00100000:1.0:1788535803.682598:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788535803.682609:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607037312:12345-0@lo:503: 00000100:00100000:1.0:1788535803.682883:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607037312:12345-0@lo:503: Request processed in 276us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535803.683101:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788535803.683349:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607037312:0@lo:503: 00000100:00100000:3.0:1788535803.683759:0:7995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:7995:1875415607037440:0@lo:502: 00000100:00100000:3.0:1788535803.683806:0:7995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535803.683843:0:7995:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535803.683922:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607037440 00000100:00100000:2.0:1788535803.683928:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607037440 00000100:00100000:2.0:1788535803.683956:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788535803.683963:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:7995:x1875415607037440:12345-0@lo:502: 00000100:00100000:2.0:1788535803.684181:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:7995:x1875415607037440:12345-0@lo:502: Request processed in 217us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535803.684190:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788535803.684430:0:7995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:7995:1875415607037440:0@lo:502: 00000020:01000000:1.0:1788535803.684456:0:7995:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535803.684466:0:7995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535803.684468:0:7995:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788535803.684473:0:7995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788535803.684475:0:7995:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788535803.684494:0:7995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:7995:1875415607037568:0@lo:502: 00000100:00100000:1.0:1788535803.684527:0:7995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535803.684656:0:7995:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9879526c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535803.684862:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607037568 00000100:00100000:3.0:1788535803.684867:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607037568 00000100:00100000:3.0:1788535803.685166:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788535803.685176:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:7995:x1875415607037568:12345-0@lo:502: 00000100:00100000:3.0:1788535803.685348:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:7995:x1875415607037568:12345-0@lo:502: Request processed in 174us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535803.685356:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788535803.685443:0:7995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:7995:1875415607037568:0@lo:502: 00000020:01000000:2.0:1788535803.685470:0:7995:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535803.685475:0:7995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535803.685483:0:7995:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788535803.685488:0:7995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1788535803.689066:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788535803.689103:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788535803.689122:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535803.689134:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535803.689144:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788535803.689147:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a9ac46a000 from 30 10000000:01000000:0.0:1788535803.689150:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788535803.689191:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535803.689199:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535803.689219:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535803.689254:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607037696:0@lo:101: 00000100:00100000:0.0:1788535803.689321:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535803.693371:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987efd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535803.693622:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607037696 00000100:00100000:1.0:1788535803.693631:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607037696 00000100:00100000:1.0:1788535803.693680:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788535803.693690:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607037696:12345-0@lo:101: 00010000:00010000:1.0:1788535803.693705:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535803.693722:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981653200/0x74f51638375d38d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d38d0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.693747:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981653200/0x74f51638375d38d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d38d0 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.693758:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981653200/0x74f51638375d38d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d38d0 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.693767:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981653200, rc 0) 00000100:00100000:1.0:1788535803.693837:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607037696:12345-0@lo:101: Request processed in 148us (4515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535803.693845:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788535803.696043:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607037696:0@lo:101: 00010000:00010000:0.0:1788535803.696144:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535803.696158:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d38d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535803.696301:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607037824:0@lo:501: 00000100:00100000:0.0:1788535803.696368:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535803.696424:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987efd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535803.696634:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607037824 00000100:00100000:2.0:1788535803.696641:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607037824 00000100:00100000:2.0:1788535803.696688:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788535803.696697:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607037824:12345-0@lo:501: 00000100:00100000:2.0:1788535803.696973:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607037824:12345-0@lo:501: Request processed in 276us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535803.696981:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788535803.697185:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607037824:0@lo:501: 00000100:00100000:0.0:1788535803.697216:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607037952:0@lo:503: 00000100:00100000:0.0:1788535803.697270:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535803.697301:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987efd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535803.697516:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607037952 00000100:00100000:2.0:1788535803.697522:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607037952 00000100:00100000:2.0:1788535803.697639:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788535803.697647:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607037952:12345-0@lo:503: 00000100:00100000:2.0:1788535803.697799:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607037952:12345-0@lo:503: Request processed in 153us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535803.697807:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788535803.698266:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607037952:0@lo:503: 00000100:00100000:0.0:1788535803.701135:0:7999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:7999:1875415607038080:0@lo:502: 00000100:00100000:0.0:1788535803.701221:0:7999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535803.701371:0:7999:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987efd000 going to sleep for 11 seconds 00000100:00100000:1.0:1788535803.701419:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607038080 00000100:00100000:1.0:1788535803.701428:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607038080 00000100:00100000:1.0:1788535803.701523:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788535803.701534:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:7999:x1875415607038080:12345-0@lo:502: 00000100:00100000:1.0:1788535803.701842:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:7999:x1875415607038080:12345-0@lo:502: Request processed in 309us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535803.701850:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788535803.703099:0:7999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:7999:1875415607038080:0@lo:502: 00000100:00100000:2.0:1788535803.703174:0:7999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:7999:1875415607038208:0@lo:502: 00000100:00100000:2.0:1788535803.703230:0:7999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535803.703310:0:7999:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788535803.704245:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607038208 00000100:00100000:3.0:1788535803.704254:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607038208 00000100:00100000:3.0:1788535803.704352:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788535803.704364:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:7999:x1875415607038208:12345-0@lo:502: 00000100:00100000:3.0:1788535803.704726:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:7999:x1875415607038208:12345-0@lo:502: Request processed in 366us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535803.704735:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788535803.708148:0:7999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:7999:1875415607038208:0@lo:502: 00000040:00080000:2.0:1788535803.708192:0:7999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788535803.708333:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788535803.708351:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788535803.708361:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.708388:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535803.708397:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788535803.708400:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a9ac46a000 from 5 10000000:01000000:1.0:1788535803.708403:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788535803.708439:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.708447:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.708457:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535803.708476:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607038336:0@lo:101: 00000100:00100000:1.0:1788535803.708544:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535803.708580:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98a6ebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535803.708678:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607038336 00000100:00100000:2.0:1788535803.708685:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607038336 00000100:00100000:2.0:1788535803.708720:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788535803.708728:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607038336:12345-0@lo:101: 00010000:00010000:2.0:1788535803.708739:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535803.708756:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9c216da00/0x74f51638375d38e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d38de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535803.708778:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9c216da00/0x74f51638375d38e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d38de expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535803.708788:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9c216da00/0x74f51638375d38e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d38de expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535803.708795:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216da00, rc 0) 00000100:00100000:2.0:1788535803.708839:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607038336:12345-0@lo:101: Request processed in 111us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535803.708846:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788535803.709643:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607038336:0@lo:101: 00010000:00010000:1.0:1788535803.709659:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.709827:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535803.709909:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607038464:0@lo:256: 00000100:00100000:1.0:1788535803.709959:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535803.709994:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98a6ebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535803.710107:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607038464 00000100:00100000:2.0:1788535803.710112:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607038464 00000100:00100000:2.0:1788535803.710142:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788535803.710150:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607038464:12345-0@lo:256: 20000000:01000000:2.0:1788535803.710175:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788535803.710190:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788535803.710194:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788535803.710277:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607038464:12345-0@lo:256: Request processed in 127us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535803.710285:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788535803.710515:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607038464:0@lo:256: 10000000:01000000:1.0:1788535803.710625:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788535803.710632:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.710641:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535803.710649:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788535803.710651:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788535803.710654:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788535803.710673:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.710680:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.710688:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535803.710700:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607038592:0@lo:101: 00000100:00100000:1.0:1788535803.710726:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535803.710747:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98930d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788535803.711133:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607038592 00000100:00100000:3.0:1788535803.711145:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607038592 00000100:00100000:3.0:1788535803.711193:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788535803.711200:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607038592:12345-0@lo:101: 00010000:00010000:3.0:1788535803.711209:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535803.711220:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a98ab4b000/0x74f51638375d38f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d38ec expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535803.711236:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4b000/0x74f51638375d38f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d38ec expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535803.711246:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a98ab4b000/0x74f51638375d38f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d38ec expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535803.711253:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b000, rc 0) 00000100:00100000:3.0:1788535803.711285:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607038592:12345-0@lo:101: Request processed in 86us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535803.711291:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788535803.711426:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607038592:0@lo:101: 00010000:00010000:1.0:1788535803.711438:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.711445:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d38f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535803.711497:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607038720:0@lo:501: 00000100:00100000:1.0:1788535803.711522:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535803.711617:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98930d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788535803.711695:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607038720 00000100:00100000:2.0:1788535803.711699:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607038720 00000100:00100000:2.0:1788535803.711728:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788535803.711734:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607038720:12345-0@lo:501: 00000100:00100000:2.0:1788535803.711982:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607038720:12345-0@lo:501: Request processed in 247us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535803.711996:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788535803.712491:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607038720:0@lo:501: 00000100:00100000:1.0:1788535803.712526:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607038848:0@lo:503: 00000100:00100000:1.0:1788535803.712995:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535803.713021:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98930d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788535803.714148:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607038848 00000100:00100000:2.0:1788535803.714160:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607038848 00000100:00100000:2.0:1788535803.714203:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788535803.714211:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607038848:12345-0@lo:503: 00000100:00100000:2.0:1788535803.714509:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607038848:12345-0@lo:503: Request processed in 298us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535803.714517:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788535803.715697:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607038848:0@lo:503: 00000100:00100000:1.0:1788535803.715959:0:8001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8001:1875415607038976:0@lo:502: 00000100:00100000:1.0:1788535803.716013:0:8001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535803.716054:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607038976 00000100:00100000:1.0:1788535803.716060:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607038976 00000100:00100000:1.0:1788535803.716091:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788535803.716097:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:8001:x1875415607038976:12345-0@lo:502: 00000100:00100000:1.0:1788535803.716364:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:8001:x1875415607038976:12345-0@lo:502: Request processed in 266us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535803.716371:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788535803.716428:0:8001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98930d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535803.716441:0:8001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8001:1875415607038976:0@lo:502: 00000020:01000000:1.0:1788535803.716463:0:8001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788535803.716470:0:8001:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788535803.716477:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535803.716479:0:8001:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788535803.716483:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788535803.716492:0:8001:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:1.0:1788535803.716515:0:8001:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788535803.716518:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788535803.717089:0:8001:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97a9b67c8000) 00000020:00000080:1.0:1788535803.717114:0:8001:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788535803.717121:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788535803.717261:0:8001:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788535803.717266:0:8001:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788535803.717273:0:8001:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d3901 00010000:00080000:1.0:1788535803.717302:0:8001:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a9bf1ef800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788535803.717531:0:8001:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788535803.719771:0:8001:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788535803.719787:0:8001:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788535803.726912:0:8001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788535803.727623:0:8001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788535803.727681:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788535803.727740:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788535803.728959:0:8004:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788535803.728965:0:8004:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788535803.735678:0:8001:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788535803.735695:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788535803.735732:0:8001:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788535803.735754:0:8001:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74f51638375d3908 00000100:00080000:1.0:1788535803.735764:0:8001:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788535803.735771:0:8001:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a9bf1ef800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788535803.735807:0:8001:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b74d1500 x1875415607039104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788535803.735836:0:8001:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788535803.735883:0:8001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535803.735906:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535803.735914:0:8001:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788535803.735919:0:8001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535803.735923:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535803.735925:0:8001:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788535803.735928:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788535803.735929:0:8001:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788535803.735960:0:8001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8001:1875415607039232:0@lo:502: 00000100:00100000:1.0:1788535803.736607:0:8001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535803.736652:0:8001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98930d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788535803.736682:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607039232 00000100:00100000:1.0:1788535803.736688:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607039232 00000100:00100000:1.0:1788535803.736725:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788535803.736734:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:8001:x1875415607039232:12345-0@lo:502: 00000100:00100000:1.0:1788535803.736993:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:8001:x1875415607039232:12345-0@lo:502: Request processed in 259us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535803.737000:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788535803.737481:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607039744:0@lo:400: 00000100:00100000:3.0:1788535803.737520:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535803.737547:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535803.737553:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607039616:0@lo:400: 00000100:00100000:3.0:1788535803.737578:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535803.737605:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607039616 00000100:00100000:3.0:1788535803.737610:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607039616 00000100:00100000:3.0:1788535803.737645:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788535803.737653:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607039616:12345-0@lo:400: 00000100:00100000:3.0:1788535803.737693:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607039616:12345-0@lo:400: Request processed in 41us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535803.737700:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788535803.737743:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a986aa0700 x1875415607039616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535803.737756:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607039616:0@lo:400: 00000100:00100000:1.0:1788535803.738142:0:8001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8001:1875415607039232:0@lo:502: 00000020:01000000:1.0:1788535803.738241:0:8001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535803.738249:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535803.738251:0:8001:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788535803.738255:0:8001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788535803.738363:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788535803.738392:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788535803.738402:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.738413:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535803.738423:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788535803.738431:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97a986be19c0 from 1 10000000:01000000:1.0:1788535803.738434:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788535803.738462:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.738471:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535803.738478:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535803.738492:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607039872:0@lo:101: 00000100:00100000:1.0:1788535803.738527:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535803.738544:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98930d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788535803.739285:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607039104:0@lo:8: 00000100:00100000:2.0:1788535803.739326:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535803.739373:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607039104 00000100:00100000:2.0:1788535803.739391:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607039104 00000100:00100000:2.0:1788535803.739418:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788535803.739423:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875415607039104:12345-0@lo:8: 00010000:00080000:2.0:1788535803.739447:0:6671:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1788535803.739473:0:6671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74f51638375d3916 00002000:00100000:2.0:1788535803.739484:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97a9bfc94800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788535803.739489:0:6671:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788535803.739492:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788535803.739619:0:6671:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788535803.739764:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788535803.739790:0:6671:0:(import.c:65:import_set_state_nolock()) ffff97a9bfc91000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788535803.739838:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875415607039104:12345-0@lo:8: Request processed in 413us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535803.739844:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788535803.739868:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607039872 00000100:00100000:2.0:1788535803.739878:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607039872 00000100:00100000:2.0:1788535803.739928:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788535803.739935:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607039872:12345-0@lo:101: 00010000:00010000:2.0:1788535803.739943:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535803.739957:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9c216d400/0x74f51638375d391d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d390f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535803.739978:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9c216d400/0x74f51638375d391d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d390f expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535803.739990:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9c216d400/0x74f51638375d391d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d390f expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535803.739999:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216d400, rc 0) 00000100:00100000:2.0:1788535803.740026:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607039872:12345-0@lo:101: Request processed in 93us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535803.740044:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:2.0:1788535803.740094:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d1500 x1875415607039104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788535813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535803.740104:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788535803.740111:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788535803.740118:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788535803.740123:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788535803.740125:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a9bf1ef800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788535803.740134:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788535803.740139:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607039104:0@lo:8: 00000100:00100000:2.0:1788535803.740166:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607039872:0@lo:101: 00010000:00010000:2.0:1788535803.740179:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d391d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535803.740193:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d391d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535803.740243:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607040000:0@lo:501: 00000100:00100000:2.0:1788535803.740270:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535803.740286:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788535803.740298:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607040000 00000100:00100000:2.0:1788535803.740301:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607040000 00000100:00100000:2.0:1788535803.740322:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788535803.740327:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607040000:12345-0@lo:501: 00000100:00100000:2.0:1788535803.740524:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607040000:12345-0@lo:501: Request processed in 195us (252us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788535803.740532:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788535803.740561:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607040000:0@lo:501: 10000000:01000000:2.0:1788535803.740581:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788535803.740588:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d391d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535803.740596:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d391d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788535803.744681:0:8004:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788535803.744828:0:8004:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 205875940022ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788535803.746845:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607039360:0@lo:400: 00000100:00100000:0.0:1788535803.746937:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535803.746978:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535803.746985:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607039488:0@lo:400: 00000100:00100000:0.0:1788535803.747004:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535803.747049:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607039744 00000100:00100000:0.0:1788535803.747056:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607039744 00000100:00100000:0.0:1788535803.747092:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607039360 00000100:00100000:0.0:1788535803.747095:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607039360 00000100:00100000:0.0:1788535803.747104:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607039488 00000100:00100000:0.0:1788535803.747106:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607039488 00000100:00100000:0.0:1788535803.747119:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788535803.747126:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607039744:12345-0@lo:400: 00000100:00100000:0.0:1788535803.747192:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607039744:12345-0@lo:400: Request processed in 65us (9671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535803.747198:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788535803.747214:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788535803.747219:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607039360:12345-0@lo:400: 00000100:00100000:0.0:1788535803.747247:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607039360:12345-0@lo:400: Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535803.747252:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788535803.747263:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788535803.747269:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607039488:12345-0@lo:400: 00000100:00100000:0.0:1788535803.747293:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607039488:12345-0@lo:400: Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535803.747298:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788535803.747346:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a986aa1500 x1875415607039744/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535803.747384:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607039744:0@lo:400: 00010000:00080000:0.0:1788535803.747421:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a986aa0380 x1875415607039488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535803.747429:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607039488:0@lo:400: 00010000:00080000:0.0:1788535803.747437:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a986aa2680 x1875415607039360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535803.747443:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607039360:0@lo:400: 00010000:00010000:1.0:1788535803.792793:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788535803.808183:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788535803.808325:0:8006:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788535803.808353:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8006:1875415607040256:0@lo:7: 00000100:00100000:1.0:1788535803.808438:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535803.808486:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98930d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535803.808501:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788535803.808513:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607040128:0@lo:13: 00000100:00100000:1.0:1788535803.808539:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535803.808754:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607040128 00000100:00100000:1.0:1788535803.808763:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607040128 00000100:00100000:1.0:1788535803.808823:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788535803.808833:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875415607040128:12345-0@lo:13: 00002000:00000024:1.0:1788535803.808877:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788535803.808949:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875415607040128:12345-0@lo:13: Request processed in 118us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535803.808956:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788535803.808993:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d2680 x1875415607040128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535803.809010:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607040128:0@lo:13: 00000100:00080000:0.0:1788535803.809071:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788535803.809251:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607040256 00000100:00100000:0.0:1788535803.809256:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607040256 00000100:00100000:0.0:1788535803.809289:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788535803.809296:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8006:x1875415607040256:12345-0@lo:7: 00002000:00080000:0.0:1788535803.824031:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788535803.824040:0:6671:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788535803.824641:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8006:x1875415607040256:12345-0@lo:7: Request processed in 15340us (16198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535803.824653:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788535803.825510:0:8006:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d2a00 x1875415607040256/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788535819 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535803.825527:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8006:1875415607040256:0@lo:7: 00000004:00080000:1.0:1788535803.825546:0:8006:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788535803.825589:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8006:1875415607040384:0@lo:5: 00000100:00100000:1.0:1788535803.825638:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535803.825728:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98930d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535803.825764:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607040384 00000100:00100000:0.0:1788535803.825771:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607040384 00000100:00100000:0.0:1788535803.825857:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788535803.825868:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8006:x1875415607040384:12345-0@lo:5: 00002000:00080000:0.0:1788535803.825936:0:6673:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788535803.825940:0:6673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788535803.826296:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8006:x1875415607040384:12345-0@lo:5: Request processed in 428us (654us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788535803.826310:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788535803.826536:0:8006:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d2a00 x1875415607040384/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788535819 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535803.826550:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8006:1875415607040384:0@lo:5: 00000004:00080000:1.0:1788535803.826560:0:8006:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788535803.826653:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8006:1875415607040512:0@lo:700: 00000100:00100000:1.0:1788535803.826751:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535803.826783:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98930d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535803.827063:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607040512 00000100:00100000:2.0:1788535803.827068:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607040512 00000100:00100000:2.0:1788535803.827117:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788535803.827125:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8006:x1875415607040512:12345-0@lo:700: 00000100:00100000:2.0:1788535803.827158:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6680:1875415607040640:0@lo:700: 00000100:00100000:2.0:1788535803.827194:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535803.827229:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b7384780 going to sleep for 11 seconds 00000100:00100000:1.0:1788535803.827279:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607040640 00000100:00100000:1.0:1788535803.827283:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607040640 00000100:00100000:1.0:1788535803.827347:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788535803.827354:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6680:x1875415607040640:12345-0@lo:700: 40000000:02000000:1.0:1788535803.890819:0:5839:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788535803.904215:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6680:x1875415607040640:12345-0@lo:700: Request processed in 76854us (77012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535803.904230:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788535803.912026:0:6680:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d6300 x1875415607040640/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788535819 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535803.913144:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6680:1875415607040640:0@lo:700: 40000000:02000000:0.0:1788535803.913162:0:6680:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1788535804.093619:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8006:x1875415607040512:12345-0@lo:700: Request processed in 266487us (266858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535804.093636:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1788535804.093677:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788535804.093690:0:7609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1788535804.093734:0:8006:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d1500 x1875415607040512/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788535819 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535804.093750:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8006:1875415607040512:0@lo:700: 00000004:02000040:0.0:1788535804.157818:0:8006:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788535804.167355:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8006:1875415607040768:0@lo:5: 00000100:00100000:0.0:1788535804.167431:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535804.167534:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987efd240 going to sleep for 11 seconds 00000100:00100000:2.0:1788535804.171820:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607040768 00000100:00100000:2.0:1788535804.171899:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607040768 00000100:00100000:1.0:1788535804.172073:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788535804.172085:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8006:x1875415607040768:12345-0@lo:5: 00002000:00080000:1.0:1788535804.180977:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788535804.180997:0:6671:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788535804.189525:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8006:x1875415607040768:12345-0@lo:5: Request processed in 17433us (22083us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788535804.189538:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788535804.189737:0:8006:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d06300 x1875415607040768/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788535820 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535804.189750:0:8006:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788535804.189847:0:8006:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff97a9b8d06300 x1875415607040768/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788535820 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535804.189859:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8006:1875415607040768:0@lo:5: 00000004:00080000:0.0:1788535804.189873:0:8006:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788535804.813087:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535805.198339:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607040896:0@lo:13: 00000100:00100000:1.0:1788535805.198418:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535805.198594:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607040896 00000100:00100000:2.0:1788535805.198603:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607040896 00000100:00100000:2.0:1788535805.198682:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788535805.198691:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607040896:12345-0@lo:13: 00002000:00000024:2.0:1788535805.198726:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788535805.198794:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535805.212223:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607040896:12345-0@lo:13: Request processed in 13523us (13795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535805.212238:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788535805.218444:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d05180 x1875415607040896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535805.218480:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607040896:0@lo:13: 00010000:00010000:0.0:1788535805.843003:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535806.861062:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788535807.746995:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788535807.885318:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535808.275252:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535808.275358:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589191808 00000100:00100000:1.0:1788535808.275376:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589191808 00000100:00100000:1.0:1788535808.275428:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:1.0:1788535808.275437:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2354:x1875415589191808:12345-192.168.203.12@tcp:250: 00010000:00080000:1.0:1788535808.275466:0:5825:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8f489c5f-831c-44bf-8a5a-dfa0a2f87b19@192.168.203.12@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1788535808.275495:0:5825:0:(genops.c:1385:class_connect()) connect: client 8f489c5f-831c-44bf-8a5a-dfa0a2f87b19, cookie 0x74f51638375d3924 00000100:00080000:1.0:1788535808.275628:0:5825:0:(import.c:65:import_set_state_nolock()) ffff97a9b6d5d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788535808.275692:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+5:2354:x1875415589191808:12345-192.168.203.12@tcp:250: Request processed in 254us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535808.275700:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:3.0:1788535808.291818:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535808.292080:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589191936 00000100:00100000:2.0:1788535808.292093:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589191936 00000100:00100000:2.0:1788535808.292154:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:2.0:1788535808.292165:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+5:5581:x1875415589191936:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1788535808.292182:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535808.292202:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9c216d000/0x74f51638375d392b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751551e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.292230:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9c216d000/0x74f51638375d392b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751551e expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.292241:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9c216d000/0x74f51638375d392b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751551e expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.292250:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216d000, rc 0) 00000100:00100000:2.0:1788535808.292300:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+6:5581:x1875415589191936:12345-192.168.203.12@tcp:101: Request processed in 137us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.292317:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:0.0:1788535808.299516:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535808.299580:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589192064 00000100:00100000:3.0:1788535808.299589:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589192064 00000100:00100000:3.0:1788535808.299724:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:3.0:1788535808.299735:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+6:5581:x1875415589192064:12345-192.168.203.12@tcp:501: 00000100:00100000:3.0:1788535808.300090:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+6:5581:x1875415589192064:12345-192.168.203.12@tcp:501: Request processed in 356us (580us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788535808.300099:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:3.0:1788535808.319230:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535808.319267:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589192192 00000100:00100000:3.0:1788535808.319277:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589192192 00000100:00100000:3.0:1788535808.319333:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:3.0:1788535808.319354:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+6:5581:x1875415589192192:12345-192.168.203.12@tcp:101: 00010000:00010000:3.0:1788535808.319370:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535808.319387:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a98ab4b600/0x74f51638375d3932 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515525 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535808.319417:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4b600/0x74f51638375d3932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515525 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535808.319442:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a98ab4b600/0x74f51638375d3932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515525 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535808.319451:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b600, rc 0) 00000100:00100000:3.0:1788535808.319503:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+7:5581:x1875415589192192:12345-192.168.203.12@tcp:101: Request processed in 161us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535808.319510:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:3.0:1788535808.323281:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535808.323314:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589192320 00000100:00100000:3.0:1788535808.323323:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589192320 00000100:00100000:3.0:1788535808.323387:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:3.0:1788535808.323397:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986eda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+7:5581:x1875415589192320:12345-192.168.203.12@tcp:501: 00000100:00100000:3.0:1788535808.323656:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986eda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+8:5581:x1875415589192320:12345-192.168.203.12@tcp:501: Request processed in 259us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535808.323664:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:3.0:1788535808.326497:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535808.327173:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589192448 00000100:00100000:1.0:1788535808.327185:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589192448 00000100:00100000:1.0:1788535808.327259:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:1.0:1788535808.327270:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+8:5581:x1875415589192448:12345-192.168.203.12@tcp:503: 00000100:00100000:1.0:1788535808.327740:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+8:5581:x1875415589192448:12345-192.168.203.12@tcp:503: Request processed in 470us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535808.327750:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:3.0:1788535808.339064:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535808.339097:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589192576 00000100:00100000:3.0:1788535808.339106:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589192576 00000100:00100000:3.0:1788535808.339159:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:3.0:1788535808.339171:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+8:5599:x1875415589192576:12345-192.168.203.12@tcp:502: 00000100:00100000:3.0:1788535808.339515:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+8:5599:x1875415589192576:12345-192.168.203.12@tcp:502: Request processed in 343us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535808.339523:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:0.0:1788535808.359128:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535808.359207:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589192704 00000100:00100000:3.0:1788535808.359231:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589192704 00000100:00100000:3.0:1788535808.359287:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:3.0:1788535808.359298:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+8:5599:x1875415589192704:12345-192.168.203.12@tcp:502: 00000100:00100000:3.0:1788535808.359552:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+8:5599:x1875415589192704:12345-192.168.203.12@tcp:502: Request processed in 255us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535808.359561:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:3.0:1788535808.364704:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535808.364740:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589192832 00000100:00100000:3.0:1788535808.364748:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589192832 00000100:00100000:3.0:1788535808.364797:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:3.0:1788535808.364807:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+8:5581:x1875415589192832:12345-192.168.203.12@tcp:101: 00010000:00010000:3.0:1788535808.364828:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535808.364847:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a98ab4b400/0x74f51638375d3939 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751554f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535808.364883:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4b400/0x74f51638375d3939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751554f expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535808.364916:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a98ab4b400/0x74f51638375d3939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751554f expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535808.365030:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b400, rc 0) 00000100:00100000:3.0:1788535808.365091:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:5581:x1875415589192832:12345-192.168.203.12@tcp:101: Request processed in 285us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535808.365098:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:3.0:1788535808.370247:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535808.370355:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589192960 00000100:00100000:1.0:1788535808.370365:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589192960 00000100:00100000:1.0:1788535808.370419:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:1.0:1788535808.370428:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:5581:x1875415589192960:12345-192.168.203.12@tcp:256: 20000000:01000000:1.0:1788535808.370451:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788535808.370471:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788535808.370475:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788535808.370478:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788535808.370481:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788535808.372570:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:5581:x1875415589192960:12345-192.168.203.12@tcp:256: Request processed in 2134us (2323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.372583:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:3.0:1788535808.377001:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535808.377141:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589193088 00000100:00100000:0.0:1788535808.377150:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589193088 00000100:00100000:0.0:1788535808.377206:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:0.0:1788535808.377217:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:5581:x1875415589193088:12345-192.168.203.12@tcp:101: 00010000:00010000:0.0:1788535808.377232:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535808.377249:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a980031e00/0x74f51638375d3940 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515556 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535808.377277:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980031e00/0x74f51638375d3940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515556 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535808.377288:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a980031e00/0x74f51638375d3940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515556 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535808.377297:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980031e00, rc 0) 00000100:00100000:0.0:1788535808.377359:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5581:x1875415589193088:12345-192.168.203.12@tcp:101: Request processed in 144us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535808.377367:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:3.0:1788535808.378949:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535808.379620:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589193216 00000100:00100000:2.0:1788535808.379630:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589193216 00000100:00100000:2.0:1788535808.379682:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:2.0:1788535808.379690:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5581:x1875415589193216:12345-192.168.203.12@tcp:501: 00000100:00100000:2.0:1788535808.380161:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5581:x1875415589193216:12345-192.168.203.12@tcp:501: Request processed in 469us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.380170:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1788535808.385640:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535808.385719:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589193344 00000100:00100000:0.0:1788535808.385729:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589193344 00000100:00100000:0.0:1788535808.385781:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:0.0:1788535808.385791:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5581:x1875415589193344:12345-192.168.203.12@tcp:503: 00000100:00100000:0.0:1788535808.386339:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5581:x1875415589193344:12345-192.168.203.12@tcp:503: Request processed in 547us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535808.386358:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:3.0:1788535808.390632:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535808.390735:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589193472 00000100:00100000:2.0:1788535808.390745:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589193472 00000100:00100000:2.0:1788535808.390800:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:2.0:1788535808.390811:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5605:x1875415589193472:12345-192.168.203.12@tcp:502: 00000100:00100000:2.0:1788535808.391288:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5605:x1875415589193472:12345-192.168.203.12@tcp:502: Request processed in 476us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.391298:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:2.0:1788535808.395212:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535808.395536:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589193600 00000100:00100000:1.0:1788535808.395546:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589193600 00000100:00100000:1.0:1788535808.395606:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:1.0:1788535808.396021:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5605:x1875415589193600:12345-192.168.203.12@tcp:502: 00000100:00100000:1.0:1788535808.396262:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5605:x1875415589193600:12345-192.168.203.12@tcp:502: Request processed in 646us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535808.396271:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:1.0:1788535808.401463:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535808.402055:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589193728 00000100:00100000:0.0:1788535808.402067:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589193728 00000100:00100000:0.0:1788535808.402120:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1788535808.402128:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1875415589193728:12345-192.168.203.12@tcp:38: 00010000:00080000:0.0:1788535808.402160:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:0.0:1788535808.402209:0:5834:0:(genops.c:1385:class_connect()) connect: client 30a1922d-0d3f-4681-a966-cec3672631c6, cookie 0x74f51638375d3947 00000004:00100000:0.0:1788535808.402239:0:5834:0:(mdt_handler.c:7337:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788535808.402245:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788535808.457823:0:5834:0:(import.c:65:import_set_state_nolock()) ffff97a987b6b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788535808.457995:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2354:x1875415589193728:12345-192.168.203.12@tcp:38: Request processed in 55865us (56539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535808.458006:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788535808.783790:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607041280:0@lo:400: 00000100:00100000:1.0:1788535808.783867:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.783956:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535808.783963:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607041408:0@lo:400: 00000100:00100000:1.0:1788535808.784002:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.784040:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607041408 00000100:00100000:1.0:1788535808.784048:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607041408 00000100:00100000:1.0:1788535808.784105:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788535808.784114:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607041408:12345-0@lo:400: 00000100:00100000:1.0:1788535808.784165:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607041408:12345-0@lo:400: Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535808.784173:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788535808.784195:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788535808.784222:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d4a80 x1875415607041408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535808.784234:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607041408:0@lo:400: 00000100:00100000:2.0:1788535808.785812:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607041280 00000100:00100000:2.0:1788535808.785826:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607041280 00000100:00100000:2.0:1788535808.785931:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788535808.785943:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607041280:12345-0@lo:400: 00000100:00100000:2.0:1788535808.786015:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607041280:12345-0@lo:400: Request processed in 76us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.786035:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788535808.786199:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607041152:0@lo:400: 00000100:00100000:3.0:1788535808.786239:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535808.786270:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607041664:0@lo:400: 00000100:00100000:3.0:1788535808.786298:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535808.786329:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788535808.786336:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607041024:0@lo:400: 00000100:00100000:3.0:1788535808.786375:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535808.786394:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607041536:0@lo:400: 00000100:00100000:3.0:1788535808.786428:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535808.786456:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607041664 00000100:00100000:3.0:1788535808.786460:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607041664 00000100:00100000:3.0:1788535808.786488:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788535808.786499:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607041664:12345-0@lo:400: 00000100:00100000:3.0:1788535808.786534:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607041664:12345-0@lo:400: Request processed in 39us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535808.786540:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788535808.786558:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607041152 00000100:00100000:3.0:1788535808.786561:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607041152 00000100:00100000:3.0:1788535808.786579:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607041536 00000100:00100000:3.0:1788535808.786582:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607041536 00000100:00100000:3.0:1788535808.786599:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788535808.786606:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607041152:12345-0@lo:400: 00000100:00100000:3.0:1788535808.787014:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607041152:12345-0@lo:400: Request processed in 408us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535808.787022:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788535808.787035:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788535808.787050:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607041536:12345-0@lo:400: 00000100:00100000:3.0:1788535808.787076:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607041536:12345-0@lo:400: Request processed in 29us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535808.787081:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788535808.787111:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d5180 x1875415607041536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535808.787122:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607041536:0@lo:400: 00010000:00080000:3.0:1788535808.787131:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d5880 x1875415607041152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535808.787138:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607041152:0@lo:400: 00010000:00080000:3.0:1788535808.787147:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d6d80 x1875415607041664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535808.787154:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788535808.787165:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607041664:0@lo:400: 00000100:00080000:1.0:1788535808.787561:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535808.787569:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788535808.787602:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d6300 x1875415607041280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535808.787614:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607041280:0@lo:400: 00000100:00100000:2.0:1788535808.788059:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607041024 00000100:00100000:2.0:1788535808.788066:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607041024 00000100:00100000:2.0:1788535808.788112:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788535808.788120:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3311:x1875415607041024:12345-0@lo:400: 00000100:00100000:2.0:1788535808.788178:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3311:x1875415607041024:12345-0@lo:400: Request processed in 60us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.788184:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788535808.788385:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607041024:0@lo:400: 00010000:00010000:0.0:1788535808.909131:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535809.293261:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607041792:0@lo:13: 00000100:00100000:1.0:1788535809.293345:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535809.293463:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607041792 00000100:00100000:3.0:1788535809.293470:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607041792 00000100:00100000:3.0:1788535809.293520:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788535809.293528:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607041792:12345-0@lo:13: 00002000:00000024:3.0:1788535809.293560:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788535809.293603:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607041792:12345-0@lo:13: Request processed in 76us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535809.293610:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788535809.293816:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d05500 x1875415607041792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535809.293844:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607041792:0@lo:13: 00000100:00100000:3.0:1788535809.472962:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535809.473072:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589193984 00000100:00100000:0.0:1788535809.473081:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589193984 00000100:00100000:0.0:1788535809.473206:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1788535809.473216:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:5581:x1875415589193984:12345-192.168.203.12@tcp:41: 00000004:00000024:0.0:1788535809.473256:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788535809.473322:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:5581:x1875415589193984:12345-192.168.203.12@tcp:41: Request processed in 107us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535809.473330:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1788535809.475818:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535809.476048:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589193856 00000100:00100000:2.0:1788535809.476058:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589193856 00000100:00100000:2.0:1788535809.476114:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788535809.476124:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:0:x1875415589193856:12345-192.168.203.12@tcp:41: 00000004:00000024:2.0:1788535809.476151:0:6697:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788535809.476218:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:0:x1875415589193856:12345-192.168.203.12@tcp:41: Request processed in 94us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535809.476225:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788535809.481873:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535809.482592:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589194112 00000100:00100000:0.0:1788535809.482603:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589194112 00000100:00100000:0.0:1788535809.482687:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788535809.482698:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:5581:x1875415589194112:12345-192.168.203.12@tcp:40: 00000100:00100000:0.0:1788535809.482785:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:5581:x1875415589194112:12345-192.168.203.12@tcp:40: Request processed in 90us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535809.482793:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00080000:1.0:1788535809.491214:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535809.491651:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535809.491688:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535809.491721:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535809.491756:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535809.491833:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589194624 00000100:00100000:2.0:1788535809.491842:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589194624 00000100:00100000:2.0:1788535809.491918:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:2.0:1788535809.491928:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2356:x1875415589194624:12345-192.168.203.12@tcp:400: 00000100:00100000:2.0:1788535809.492003:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2356:x1875415589194624:12345-192.168.203.12@tcp:400: Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535809.492013:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:3.0:1788535809.492405:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589194496 00000100:00100000:3.0:1788535809.492411:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589194496 00000100:00100000:3.0:1788535809.492465:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788535809.492474:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:5581:x1875415589194496:12345-192.168.203.12@tcp:33: 00000100:00100000:3.0:1788535809.492551:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589194240 00000100:00100000:3.0:1788535809.492554:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589194240 00000100:00100000:3.0:1788535809.492568:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589194368 00000100:00100000:3.0:1788535809.492570:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589194368 00000100:00100000:3.0:1788535809.492579:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788535809.492583:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1875415589194240:12345-192.168.203.12@tcp:8: 00010000:00080000:3.0:1788535809.492603:0:6671:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:3.0:1788535809.492626:0:6671:0:(genops.c:1385:class_connect()) connect: client 30a1922d-0d3f-4681-a966-cec3672631c6, cookie 0x74f51638375d394e 00002000:00100000:3.0:1788535809.492637:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 30a1922d-0d3f-4681-a966-cec3672631c6/ffff97a9bf156800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788535809.492657:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788535809.493141:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788535809.493171:0:6671:0:(import.c:65:import_set_state_nolock()) ffff97a9bf157000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788535809.493219:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2354:x1875415589194240:12345-192.168.203.12@tcp:8: Request processed in 633us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535809.493227:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788535809.493243:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788535809.493248:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1875415589194368:12345-192.168.203.12@tcp:8: 00010000:00080000:3.0:1788535809.493265:0:6671:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:3.0:1788535809.493281:0:6671:0:(genops.c:1385:class_connect()) connect: client 30a1922d-0d3f-4681-a966-cec3672631c6, cookie 0x74f51638375d3955 00002000:00100000:3.0:1788535809.493287:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 30a1922d-0d3f-4681-a966-cec3672631c6/ffff97a9bf150800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788535809.493307:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788535809.495678:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788535809.495713:0:6671:0:(import.c:65:import_set_state_nolock()) ffff97a9bf154800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788535809.495782:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2354:x1875415589194368:12345-192.168.203.12@tcp:8: Request processed in 2531us (4024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535809.495792:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000004:00080000:3.0:1788535809.519588:0:5835:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27053us 00000004:00200000:3.0:1788535809.552226:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788535809.552393:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:5581:x1875415589194496:12345-192.168.203.12@tcp:33: Request processed in 59913us (60696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535809.552403:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788535809.745161:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535809.745298:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589194752 00000100:00100000:2.0:1788535809.745313:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589194752 00000100:00100000:2.0:1788535809.745451:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788535809.745463:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:5622:x1875415589194752:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1788535809.745483:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535809.745527:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c600/0x74f51638375d395c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515580 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535809.745597:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d3963 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535809.745612:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d3963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535809.745628:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d3963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535809.745661:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788535809.745665:0:6697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788535809.745680:0:6697:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d3963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535809.745705:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c600/0x74f51638375d395c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515580 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535809.745724:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d3963 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515580 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535809.745731:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a99742aa00) 00010000:00010000:2.0:1788535809.745734:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788535809.745738:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216de00, rc 0) 00000100:00100000:2.0:1788535809.745814:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+7:5622:x1875415589194752:12345-192.168.203.12@tcp:101: Request processed in 354us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535809.745830:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00010000:00010000:1.0:1788535809.933027:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535810.318398:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607041920:0@lo:13: 00000100:00100000:1.0:1788535810.318470:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535810.318707:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607041920 00000100:00100000:0.0:1788535810.318717:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607041920 00000100:00100000:0.0:1788535810.318791:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788535810.318801:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607041920:12345-0@lo:13: 00002000:00000024:0.0:1788535810.318824:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535810.318873:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607041920:12345-0@lo:13: Request processed in 74us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535810.318880:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788535810.318948:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d05f80 x1875415607041920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535810.318969:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607041920:0@lo:13: 00000100:00080000:1.0:1788535810.319157:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788535810.958278:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535811.830850:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535811.831092:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589194880 00000100:00100000:0.0:1788535811.831103:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589194880 00000100:00100000:0.0:1788535811.831182:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788535811.831192:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+7:5674:x1875415589194880:12345-192.168.203.12@tcp:41: 00000004:00000024:0.0:1788535811.831237:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788535811.831297:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+7:5674:x1875415589194880:12345-192.168.203.12@tcp:41: Request processed in 106us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535811.831315:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:1.0:1788535811.831400:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535811.834925:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535811.835054:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589195008 00000100:00100000:3.0:1788535811.835064:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589195008 00000100:00100000:3.0:1788535811.835143:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788535811.835154:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:30a1922d-0d3f-4681-a966-cec3672631c6+6:5674:x1875415589195008:12345-192.168.203.12@tcp:13: 00002000:00000024:3.0:1788535811.835192:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788535811.835254:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:30a1922d-0d3f-4681-a966-cec3672631c6+6:5674:x1875415589195008:12345-192.168.203.12@tcp:13: Request processed in 103us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535811.835262:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00080000:1.0:1788535811.835336:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535811.837169:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535811.837257:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589195136 00000100:00100000:0.0:1788535811.837266:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589195136 00000100:00100000:0.0:1788535811.837338:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788535811.837349:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:30a1922d-0d3f-4681-a966-cec3672631c6+6:5674:x1875415589195136:12345-192.168.203.12@tcp:13: 00002000:00000024:0.0:1788535811.837382:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535811.837444:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:30a1922d-0d3f-4681-a966-cec3672631c6+6:5674:x1875415589195136:12345-192.168.203.12@tcp:13: Request processed in 97us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535811.837453:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:1.0:1788535811.837720:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1788535811.907192:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 30a1922d-0d3f-4681-a966-cec3672631c6 00010000:00010000:0.0:1788535811.981370:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535813.006359:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535813.901236:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607042304:0@lo:400: 00000100:00100000:2.0:1788535813.901335:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535813.901400:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788535813.901407:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607042432:0@lo:400: 00000100:00100000:2.0:1788535813.901434:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535813.901467:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607042304 00000100:00100000:2.0:1788535813.901473:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607042304 00000100:00100000:2.0:1788535813.901526:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788535813.901536:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607042304:12345-0@lo:400: 00000100:00100000:2.0:1788535813.901584:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607042304:12345-0@lo:400: Request processed in 50us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535813.901591:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788535813.901627:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607042432 00000100:00100000:2.0:1788535813.901631:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607042432 00000100:00100000:2.0:1788535813.901660:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788535813.901667:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607042432:12345-0@lo:400: 00000100:00100000:2.0:1788535813.901698:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607042432:12345-0@lo:400: Request processed in 32us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535813.901705:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788535813.901721:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535813.901725:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788535813.901756:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d4a80 x1875415607042432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535813.901782:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607042432:0@lo:400: 00000100:00100000:2.0:1788535813.901797:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607042304:0@lo:400: 00000100:00100000:0.0:1788535813.902147:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607042048:0@lo:400: 00000100:00100000:0.0:1788535813.902187:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535813.902213:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607042560:0@lo:400: 00000100:00100000:0.0:1788535813.902236:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535813.902254:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788535813.902261:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607042176:0@lo:400: 00000100:00100000:0.0:1788535813.902280:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535813.902323:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607042688:0@lo:400: 00000100:00100000:0.0:1788535813.902345:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535813.902374:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607042048 00000100:00100000:0.0:1788535813.902379:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607042048 00000100:00100000:0.0:1788535813.902405:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788535813.902412:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607042048:12345-0@lo:400: 00000100:00100000:0.0:1788535813.902455:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607042048:12345-0@lo:400: Request processed in 44us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535813.902462:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788535813.902488:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607042560 00000100:00100000:0.0:1788535813.902491:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607042560 00000100:00100000:0.0:1788535813.902513:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607042176 00000100:00100000:0.0:1788535813.902515:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607042176 00000100:00100000:0.0:1788535813.902529:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788535813.902535:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607042560:12345-0@lo:400: 00000100:00100000:0.0:1788535813.902561:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607042560:12345-0@lo:400: Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535813.902566:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788535813.902575:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788535813.902580:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607042176:12345-0@lo:400: 00000100:00100000:0.0:1788535813.902602:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607042176:12345-0@lo:400: Request processed in 23us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535813.902608:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788535813.902637:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607042176:0@lo:400: 00000100:00100000:0.0:1788535813.902645:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607042048:0@lo:400: 00000100:00100000:0.0:1788535813.902655:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607042560:0@lo:400: 00000100:00080000:2.0:1788535813.902981:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535813.907056:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607042688 00000100:00100000:3.0:1788535813.907079:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607042688 00000100:00100000:3.0:1788535813.907250:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788535813.907266:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607042688:12345-0@lo:400: 00000100:00080000:1.0:1788535813.907296:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535813.907408:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607042688:12345-0@lo:400: Request processed in 147us (5060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535813.907436:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788535813.907508:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6d02680 x1875415607042688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535813.907528:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607042688:0@lo:400: 00000001:00100000:0.0:1788535814.012061:0:7609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 30a1922d-0d3f-4681-a966-cec3672631c6 00010000:00010000:2.0:1788535814.031976:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788535814.079880:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 30a1922d-0d3f-4681-a966-cec3672631c6 00000100:00100000:2.0:1788535814.415871:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607042816:0@lo:13: 00000100:00100000:2.0:1788535814.416002:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535814.416715:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607042816 00000100:00100000:0.0:1788535814.416730:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607042816 00000100:00100000:0.0:1788535814.416811:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788535814.416824:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607042816:12345-0@lo:13: 00002000:00000024:0.0:1788535814.416925:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535814.417008:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607042816:12345-0@lo:13: Request processed in 186us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535814.417016:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788535814.417818:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6d01f80 x1875415607042816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535814.417849:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607042816:0@lo:13: 00000100:00100000:2.0:1788535814.526502:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535814.526541:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535814.526579:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535814.526611:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535814.526657:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589195648 00000100:00100000:2.0:1788535814.526677:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589195648 00000100:00100000:2.0:1788535814.526753:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589195520 00000100:00100000:2.0:1788535814.526757:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589195520 00000100:00100000:2.0:1788535814.526781:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788535814.526793:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589195648:12345-192.168.203.12@tcp:400: 00000100:00100000:2.0:1788535814.526909:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589195648:12345-192.168.203.12@tcp:400: Request processed in 97us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535814.526918:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788535814.526937:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788535814.526943:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589195520:12345-192.168.203.12@tcp:400: 00000100:00100000:2.0:1788535814.526976:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589195520:12345-192.168.203.12@tcp:400: Request processed in 34us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535814.526982:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788535814.527000:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589195264 00000100:00100000:2.0:1788535814.527003:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589195264 00000100:00100000:2.0:1788535814.527029:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:2.0:1788535814.527034:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2358:x1875415589195264:12345-192.168.203.12@tcp:400: 00000100:00100000:2.0:1788535814.527056:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2358:x1875415589195264:12345-192.168.203.12@tcp:400: Request processed in 22us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535814.527062:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:0.0:1788535814.527480:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589195392 00000100:00100000:0.0:1788535814.527488:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589195392 00000100:00100000:0.0:1788535814.527544:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:0.0:1788535814.527552:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2358:x1875415589195392:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1788535814.527597:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2358:x1875415589195392:12345-192.168.203.12@tcp:400: Request processed in 46us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535814.527604:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00080000:0.0:1788535814.527689:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788535814.527695:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788535814.527698:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1788535814.882232:0:8259:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788535815.055745:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535815.437139:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535815.437166:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607042944:0@lo:13: 00000100:00100000:1.0:1788535815.437235:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535815.437366:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607042944 00000100:00100000:0.0:1788535815.437374:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607042944 00000100:00100000:0.0:1788535815.437440:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788535815.437449:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607042944:12345-0@lo:13: 00002000:00000024:0.0:1788535815.437483:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535815.437531:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607042944:12345-0@lo:13: Request processed in 83us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535815.437538:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788535815.437576:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d06300 x1875415607042944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535815.437596:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607042944:0@lo:13: 00000100:00080000:1.0:1788535815.437663:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788535816.077435:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535817.101151:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535818.127481:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788535818.982386:0:8408:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee653a330 20000000:00000080:0.0:1788535818.982409:0:8408:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a9b91dc800 uarg=0000000000000000 20000000:01000000:0.0:1788535818.982443:0:8408:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788535818.982446:0:8408:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788535818.982448:0:8408:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788535818.982453:0:8408:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788535818.982457:0:8408:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788535818.982619:0:8408:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788535818.982622:0:8408:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788535818.983701:0:8408:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788535818.983706:0:8408:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788535818.985476:0:8409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788535818.986875:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788535818.987034:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788535818.987076:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1788535818.987092:0:8408:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788535818.987095:0:8408:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788535818.992177:0:8410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788535818.995798:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788535818.995861:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788535818.995928:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1788535818.995945:0:8408:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788535818.995948:0:8408:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788535819.002232:0:8411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788535819.010851:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788535819.011463:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788535819.011534:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788535819.011624:0:8408:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788535819.011628:0:8408:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788535819.013475:0:8412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788535819.019217:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788535819.019313:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788535819.019349:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:1.0:1788535819.019369:0:8408:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788535819.019389:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.019406:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981653000/0x74f51638375d3867 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3860 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.019414:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a980030200/0x74f51638375d3891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d388a expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.019421:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9c216ca00/0x74f51638375d38bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d38b4 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.019428:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a98ab4b800/0x74f51638375d38c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d38c2 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.019435:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981653200/0x74f51638375d38d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d38d0 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.019453:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a98ab4b000/0x74f51638375d38f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d38ec expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.019461:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9c216d400/0x74f51638375d391d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d390f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.019471:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9c216d000/0x74f51638375d392b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751551e expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.019477:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a98ab4b600/0x74f51638375d3932 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515525 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.019484:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.019522:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a98ab4b600/0x74f51638375d3932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515525 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.019536:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a98ab4b600/0x74f51638375d3932 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515525 expref: 9 pid: 5825 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535819.020657:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043072:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535819.021373:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9c216d000/0x74f51638375d392b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751551e expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.021388:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a9c216d000/0x74f51638375d392b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751551e expref: 9 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535819.021399:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f17b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043200:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535819.021451:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9c216d400/0x74f51638375d391d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d390f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.021459:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a9c216d400/0x74f51638375d391d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d390f expref: 18 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535819.021468:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f17480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043328:0@lo:104: 00000100:00100000:1.0:1788535819.021505:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788535819.021541:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a98ab4b000/0x74f51638375d38f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d38ec expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.021619:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a98ab4b000/0x74f51638375d38f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d38ec expref: 18 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535819.021628:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f15880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043456:0@lo:104: 00000100:00100000:1.0:1788535819.021659:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788535819.021689:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981653200/0x74f51638375d38d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d38d0 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.021697:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a981653200/0x74f51638375d38d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d38d0 expref: 18 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535819.021705:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f14e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043584:0@lo:104: 00010000:00010000:1.0:1788535819.021729:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a98ab4b800/0x74f51638375d38c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d38c2 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.021801:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a98ab4b800/0x74f51638375d38c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d38c2 expref: 18 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535819.021813:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043712:0@lo:104: 00010000:00010000:1.0:1788535819.021849:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9c216ca00/0x74f51638375d38bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d38b4 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.021857:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a9c216ca00/0x74f51638375d38bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d38b4 expref: 18 pid: 5827 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535819.021865:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f14380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043840:0@lo:104: 00010000:00010000:1.0:1788535819.021903:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a980030200/0x74f51638375d3891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d388a expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.021911:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a980030200/0x74f51638375d3891 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d388a expref: 18 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535819.021918:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f14700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043968:0@lo:104: 00010000:00010000:1.0:1788535819.021943:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981653000/0x74f51638375d3867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d3860 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.021951:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a981653000/0x74f51638375d3867 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d3860 expref: 18 pid: 5827 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535819.021958:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607044096:0@lo:104: 00000100:00100000:1.0:1788535819.021974:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986b416c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535819.022060:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788535819.022092:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535819.022106:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535819.022114:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535819.022122:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535819.022129:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535819.022137:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607043328 00000100:00100000:3.0:1788535819.022143:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607043328 00000100:00100000:3.0:1788535819.022183:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607043456 00000100:00100000:3.0:1788535819.022187:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607043456 00000100:00100000:3.0:1788535819.022198:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607043584 00000100:00100000:3.0:1788535819.022200:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607043584 00000100:00100000:3.0:1788535819.022210:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607043712 00000100:00100000:3.0:1788535819.022212:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607043712 00000100:00100000:3.0:1788535819.022220:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607043840 00000100:00100000:3.0:1788535819.022223:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607043840 00000100:00100000:3.0:1788535819.022230:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607043968 00000100:00100000:3.0:1788535819.022232:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607043968 00000100:00100000:3.0:1788535819.022240:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607044096 00000100:00100000:3.0:1788535819.022242:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607044096 00000100:00100000:3.0:1788535819.022254:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788535819.022262:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+9:8408:x1875415607043328:12345-0@lo:104: 00010000:00010000:3.0:1788535819.022283:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d391d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.022349:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788535819.022356:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+9:8408:x1875415607043328:12345-0@lo:104: Request processed in 95us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535819.022362:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788535819.022379:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788535819.022386:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0969450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+8:8408:x1875415607043456:12345-0@lo:104: 00010000:00010000:3.0:1788535819.022394:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d38f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.022430:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788535819.022436:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0969450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+8:8408:x1875415607043456:12345-0@lo:104: Request processed in 52us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535819.022441:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788535819.022472:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788535819.022478:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+7:8408:x1875415607043584:12345-0@lo:104: 00010000:00010000:3.0:1788535819.022485:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d38d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.022520:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788535819.022525:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+7:8408:x1875415607043584:12345-0@lo:104: Request processed in 49us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535819.022530:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788535819.022540:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788535819.022546:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+6:8408:x1875415607043712:12345-0@lo:104: 00010000:00010000:3.0:1788535819.022564:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d38c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.022591:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788535819.022595:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+6:8408:x1875415607043712:12345-0@lo:104: Request processed in 50us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535819.022600:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788535819.022611:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788535819.022618:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:8408:x1875415607043840:12345-0@lo:104: 00010000:00010000:3.0:1788535819.022625:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d38bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.022649:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788535819.022653:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:8408:x1875415607043840:12345-0@lo:104: Request processed in 38us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535819.022659:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788535819.022670:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788535819.022676:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+4:8408:x1875415607043968:12345-0@lo:104: 00010000:00010000:3.0:1788535819.022682:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3891 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.022707:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788535819.022712:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+4:8408:x1875415607043968:12345-0@lo:104: Request processed in 37us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535819.022717:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788535819.022729:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788535819.022735:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:8408:x1875415607044096:12345-0@lo:104: 00010000:00010000:3.0:1788535819.022751:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3867 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.022779:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788535819.022783:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:8408:x1875415607044096:12345-0@lo:104: Request processed in 49us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535819.022787:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788535819.022804:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788535819.022810:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d391d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.022817:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981653400 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535819.022821:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d391d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.022829:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d391d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535819.022837:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d391d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535819.022842:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535819.022875:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d391d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.022882:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788535819.023404:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f17480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043328:0@lo:104: 00000100:00100000:1.0:1788535819.023415:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f15880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043456:0@lo:104: 00000100:00100000:1.0:1788535819.023422:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f14e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043584:0@lo:104: 00000100:00100000:1.0:1788535819.023428:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043712:0@lo:104: 00000100:00100000:1.0:1788535819.023434:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f14380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043840:0@lo:104: 00000100:00100000:1.0:1788535819.023441:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f14700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043968:0@lo:104: 00000100:00100000:1.0:1788535819.023460:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607044096:0@lo:104: 00010000:00010000:3.0:1788535819.023542:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d391d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023561:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a981653400/0x74f51638375d390f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d391d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023586:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788535819.023589:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d38f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023595:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981653600 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535819.023598:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d38f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023605:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d38f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535819.023612:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d38f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535819.023617:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535819.023634:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d38f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023640:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535819.023645:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d38f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023652:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d38ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d38f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023661:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788535819.023664:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d38d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023679:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980031c00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535819.023682:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d38d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023688:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d38d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535819.023695:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d38d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535819.023700:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535819.023715:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d38d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023721:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535819.023736:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d38d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023808:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a980031c00/0x74f51638375d38d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d38d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023819:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788535819.023822:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d38c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023829:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a000 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535819.023832:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d38c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023850:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d38c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535819.023856:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d38c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535819.023861:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535819.023876:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d38c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023882:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535819.023910:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d38c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023917:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d38c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d38c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023927:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788535819.023930:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d38bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023935:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980031000 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535819.023938:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d38bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023945:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d38bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535819.023951:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d38bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535819.023963:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535819.023978:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d38bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023984:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535819.023989:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d38bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.023995:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d38b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d38bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.024004:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788535819.024007:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3891 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.024013:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a800 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535819.024016:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d3891 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.024023:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d3891 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535819.024029:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d3891 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535819.024035:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535819.024047:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3891 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.024053:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535819.024064:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3891 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.024070:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d388a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3891 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.024080:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535819.024083:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3867 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.024089:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216c000 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535819.024092:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d3867 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.024098:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d3867 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535819.024104:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d3867 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535819.024109:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535819.024122:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3867 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.024127:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535819.024131:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3867 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.024138:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9c216c000/0x74f51638375d3860 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3867 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.024151:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535819.024159:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535819.024161:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535819.024169:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535819.024176:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535819.024189:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607044352:0@lo:103: 00000100:00100000:3.0:1788535819.024235:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535819.024288:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607044864:0@lo:103: 00000100:00100000:3.0:1788535819.024309:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535819.024331:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788535819.024336:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607044224:0@lo:103: 00000100:00100000:3.0:1788535819.024354:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535819.024367:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607044736:0@lo:103: 00000100:00100000:3.0:1788535819.024383:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535819.024406:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607044480:0@lo:103: 00000100:00100000:3.0:1788535819.024426:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535819.024435:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607044992:0@lo:103: 00000100:00100000:3.0:1788535819.024451:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535819.024462:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535819.024467:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607044608:0@lo:103: 00000100:00100000:3.0:1788535819.024490:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535819.024515:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607044352 00000100:00100000:3.0:1788535819.024520:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607044352 00010000:00010000:3.0:1788535819.024551:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a98ab4b000/0x74f51638375d38f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d38ec expref: 19 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535819.024569:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607044864 00000100:00100000:3.0:1788535819.024573:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607044864 00010000:00010000:3.0:1788535819.024584:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a980030200/0x74f51638375d3891 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d388a expref: 20 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535819.024603:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607044224 00000100:00100000:3.0:1788535819.024607:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607044224 00010000:00010000:3.0:1788535819.024621:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9c216d400/0x74f51638375d391d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d390f expref: 21 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535819.024631:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607044736 00000100:00100000:3.0:1788535819.024634:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607044736 00010000:00010000:3.0:1788535819.024645:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9c216ca00/0x74f51638375d38bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d38b4 expref: 22 pid: 5827 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535819.024654:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607044480 00000100:00100000:3.0:1788535819.024656:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607044480 00010000:00010000:3.0:1788535819.024666:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981653200/0x74f51638375d38d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d38d0 expref: 23 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535819.024674:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607044992 00000100:00100000:3.0:1788535819.024676:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607044992 00010000:00010000:3.0:1788535819.024685:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981653000/0x74f51638375d3867 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3860 expref: 24 pid: 5827 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535819.024694:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607044608 00000100:00100000:3.0:1788535819.024697:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607044608 00010000:00010000:3.0:1788535819.024705:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a98ab4b800/0x74f51638375d38c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d38c2 expref: 25 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535819.024718:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788535819.024724:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+25:3311:x1875415607044352:12345-0@lo:103: 00010000:00010000:3.0:1788535819.024734:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788535819.025133:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788535819.025144:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+25:3311:x1875415607044864:12345-0@lo:103: 00010000:00010000:0.0:1788535819.025154:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535819.025159:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a980030200/0x74f51638375d3891 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d388a expref: 25 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025170:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a980030200/0x74f51638375d3891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d388a expref: 25 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025185:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980030200/0x74f51638375d3891 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d388a expref: 25 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025197:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535819.025238:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+24:3311:x1875415607044864:12345-0@lo:103: Request processed in 97us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.025245:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788535819.025267:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788535819.025285:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+23:3311:x1875415607044224:12345-0@lo:103: 00010000:00010000:0.0:1788535819.025292:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535819.025297:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9c216d400/0x74f51638375d391d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d390f expref: 23 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025305:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9c216d400/0x74f51638375d391d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d390f expref: 23 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025315:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9c216d400/0x74f51638375d391d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d390f expref: 23 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025323:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535819.025345:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+22:3311:x1875415607044224:12345-0@lo:103: Request processed in 62us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.025351:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788535819.025362:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788535819.025368:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+21:3311:x1875415607044736:12345-0@lo:103: 00010000:00010000:0.0:1788535819.025387:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535819.025392:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9c216ca00/0x74f51638375d38bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d38b4 expref: 21 pid: 5827 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025400:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9c216ca00/0x74f51638375d38bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d38b4 expref: 21 pid: 5827 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025409:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9c216ca00/0x74f51638375d38bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d38b4 expref: 21 pid: 5827 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025418:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535819.025439:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+20:3311:x1875415607044736:12345-0@lo:103: Request processed in 71us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.025449:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788535819.025461:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788535819.025466:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607044480:12345-0@lo:103: 00010000:00010000:0.0:1788535819.025472:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535819.025476:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981653200/0x74f51638375d38d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d38d0 expref: 19 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025485:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981653200/0x74f51638375d38d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d38d0 expref: 19 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025494:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981653200/0x74f51638375d38d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d38d0 expref: 19 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025503:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535819.025529:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:3308:x1875415607044480:12345-0@lo:103: Request processed in 63us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.025534:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788535819.025557:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788535819.025566:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:3308:x1875415607044992:12345-0@lo:103: 00010000:00010000:0.0:1788535819.025573:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535819.025578:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981653000/0x74f51638375d3867 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3860 expref: 17 pid: 5827 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025587:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981653000/0x74f51638375d3867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d3860 expref: 17 pid: 5827 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025596:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981653000/0x74f51638375d3867 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d3860 expref: 17 pid: 5827 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025614:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535819.025639:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:3308:x1875415607044992:12345-0@lo:103: Request processed in 74us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.025645:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788535819.025658:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788535819.025664:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:3308:x1875415607044608:12345-0@lo:103: 00010000:00010000:0.0:1788535819.025671:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535819.025675:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a98ab4b800/0x74f51638375d38c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d38c2 expref: 15 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025683:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a98ab4b800/0x74f51638375d38c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d38c2 expref: 15 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025692:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4b800/0x74f51638375d38c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d38c2 expref: 15 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.025700:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535819.025720:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:3308:x1875415607044608:12345-0@lo:103: Request processed in 56us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.025726:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788535819.025926:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607044608:0@lo:103: 00000100:00100000:0.0:1788535819.025937:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607044480:0@lo:103: 00000100:00100000:0.0:1788535819.025945:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607044992:0@lo:103: 00010000:00010000:3.0:1788535819.026011:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a98ab4b000/0x74f51638375d38f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d38ec expref: 13 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.026030:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a98ab4b000/0x74f51638375d38f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d38ec expref: 13 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.026039:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4b000/0x74f51638375d38f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d38ec expref: 13 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.026047:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535819.026074:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:3311:x1875415607044352:12345-0@lo:103: Request processed in 1350us (1839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535819.026079:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788535819.026156:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607044224:0@lo:103: 00000100:00100000:3.0:1788535819.026165:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607044736:0@lo:103: 00000100:00100000:3.0:1788535819.026172:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607044352:0@lo:103: 00000100:00100000:3.0:1788535819.026179:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607044864:0@lo:103: 00000100:00100000:0.0:1788535819.029161:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607045248:0@lo:400: 00000100:00100000:0.0:1788535819.029222:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535819.029283:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535819.029290:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607045376:0@lo:400: 00000100:00100000:0.0:1788535819.029317:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535819.029347:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607045248 00000100:00100000:0.0:1788535819.029354:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607045248 00000100:00100000:0.0:1788535819.029405:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788535819.029414:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607045248:12345-0@lo:400: 00000100:00100000:0.0:1788535819.029460:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607045248:12345-0@lo:400: Request processed in 48us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.029467:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788535819.029487:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535819.029498:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607045504:0@lo:400: 00000100:00100000:0.0:1788535819.029523:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535819.029541:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788535819.029546:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607045120:0@lo:400: 00000100:00100000:0.0:1788535819.029582:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535819.029599:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607045632:0@lo:400: 00000100:00100000:0.0:1788535819.029633:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535819.029661:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607045504 00000100:00100000:0.0:1788535819.029665:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607045504 00000100:00100000:0.0:1788535819.029692:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607045120 00000100:00100000:0.0:1788535819.029695:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607045120 00000100:00100000:0.0:1788535819.029707:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788535819.029713:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607045504:12345-0@lo:400: 00000100:00100000:0.0:1788535819.029746:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607045504:12345-0@lo:400: Request processed in 33us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.029752:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788535819.029767:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788535819.029779:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607045120:12345-0@lo:400: 00000100:00100000:0.0:1788535819.029807:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607045120:12345-0@lo:400: Request processed in 29us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.029813:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788535819.029830:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535819.029859:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607045248:0@lo:400: 00000100:00100000:0.0:1788535819.029916:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607045120:0@lo:400: 00000100:00100000:0.0:1788535819.029925:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607045504:0@lo:400: 00000100:00100000:2.0:1788535819.032381:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607045376 00000100:00100000:2.0:1788535819.032672:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607045376 00000100:00100000:2.0:1788535819.032743:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607045632 00000100:00100000:2.0:1788535819.032748:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607045632 00000100:00100000:2.0:1788535819.032779:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788535819.032789:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607045376:12345-0@lo:400: 00000100:00100000:2.0:1788535819.033125:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607045376:12345-0@lo:400: Request processed in 337us (3805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535819.033134:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788535819.033167:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788535819.033186:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607045632:12345-0@lo:400: 00000100:00100000:2.0:1788535819.033232:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607045632:12345-0@lo:400: Request processed in 59us (3598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535819.033239:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788535819.033500:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535819.033505:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788535819.033541:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d04e00 x1875415607045376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535819.033558:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607045376:0@lo:400: 00010000:00080000:2.0:1788535819.033595:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d0000 x1875415607045632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535819.033604:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607045632:0@lo:400: 00000100:00100000:1.0:1788535819.039816:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043072:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788535819.039832:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f17b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8408:1875415607043200:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535819.039876:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535819.043841:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535819.043904:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535819.044015:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589195776 00000100:00100000:0.0:1788535819.044025:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589195776 00010000:00010000:0.0:1788535819.044062:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a98ab4b600/0x74f51638375d3932 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515525 expref: 10 pid: 5825 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535819.044101:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589195904 00000100:00100000:0.0:1788535819.044104:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589195904 00010000:00010000:0.0:1788535819.044116:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9c216d000/0x74f51638375d392b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751551e expref: 11 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535819.044135:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1788535819.044145:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:2355:x1875415589195776:12345-192.168.203.12@tcp:103: 00010000:00010000:0.0:1788535819.044158:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535819.044163:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a98ab4b600/0x74f51638375d3932 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515525 expref: 11 pid: 5825 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044176:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a98ab4b600/0x74f51638375d3932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515525 expref: 11 pid: 5825 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044194:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4b600/0x74f51638375d3932 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515525 expref: 11 pid: 5825 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044218:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535819.044286:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2355:x1875415589195776:12345-192.168.203.12@tcp:103: Request processed in 142us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.044294:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1788535819.044312:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:0.0:1788535819.044319:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:2355:x1875415589195904:12345-192.168.203.12@tcp:103: 00010000:00010000:0.0:1788535819.044326:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535819.044331:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9c216d000/0x74f51638375d392b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751551e expref: 9 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044340:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9c216d000/0x74f51638375d392b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751551e expref: 9 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044350:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9c216d000/0x74f51638375d392b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751551e expref: 9 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044361:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044370:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044385:0:7598:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044393:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044399:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044413:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044420:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981652200 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788535819.044424:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044433:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044446:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535819.044456:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535819.044476:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+8:2355:x1875415589195904:12345-192.168.203.12@tcp:103: Request processed in 157us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.044483:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00010000:00010000:1.0:1788535819.044546:0:8408:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.044565:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535819.044576:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981652200/0x74f51638375d396a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535819.149050:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535819.533273:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535819.533298:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607045760:0@lo:13: 00000100:00100000:3.0:1788535819.533360:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535819.533482:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607045760 00000100:00100000:1.0:1788535819.533491:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607045760 00000100:00100000:1.0:1788535819.533547:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788535819.533556:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607045760:12345-0@lo:13: 00002000:00000024:1.0:1788535819.533592:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535819.533645:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607045760:12345-0@lo:13: Request processed in 89us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535819.533652:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788535819.534462:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6d02300 x1875415607045760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535819.534489:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607045760:0@lo:13: 00000100:00100000:0.0:1788535819.635386:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535819.635440:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535819.635552:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589196032 00000100:00100000:2.0:1788535819.635566:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589196032 00000100:00100000:0.0:1788535819.635590:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00080000:3.0:1788535819.635631:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535819.635748:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1788535819.635759:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2357:x1875415589196032:12345-192.168.203.12@tcp:400: 00000100:00100000:2.0:1788535819.635831:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2357:x1875415589196032:12345-192.168.203.12@tcp:400: Request processed in 73us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535819.636688:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589196288 00000100:00100000:0.0:1788535819.636689:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589196160 00000100:00100000:0.0:1788535819.636698:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589196160 00000100:00100000:1.0:1788535819.636699:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589196288 00000100:00100000:1.0:1788535819.636768:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00080000:3.0:1788535819.636772:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535819.636777:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788535819.636778:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2357:x1875415589196288:12345-192.168.203.12@tcp:400: 00000100:00100000:3.0:1788535819.636802:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788535819.636811:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788535819.636842:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2357:x1875415589196288:12345-192.168.203.12@tcp:400: Request processed in 66us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535819.636858:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788535819.636878:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788535819.636905:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2357:x1875415589196160:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1788535819.637097:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2357:x1875415589196160:12345-192.168.203.12@tcp:400: Request processed in 211us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535819.637436:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788535819.637626:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00010000:00010000:3.0:1788535820.173167:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788535820.430102:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788535820.430110:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a986ffc800 from 39 10000000:01000000:2.0:1788535820.430131:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788535820.430188:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.430200:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.430212:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535820.430237:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607045888:0@lo:101: 00000100:00100000:2.0:1788535820.430327:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.430407:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535820.430855:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607045888 00000100:00100000:0.0:1788535820.430864:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607045888 00000100:00100000:0.0:1788535820.430948:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788535820.430958:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+12:5830:x1875415607045888:12345-0@lo:101: 00010000:00010000:0.0:1788535820.430970:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535820.430984:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a980030400/0x74f51638375d3978 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3971 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535820.431013:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980030400/0x74f51638375d3978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3971 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535820.431023:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a980030400/0x74f51638375d3978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3971 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535820.431032:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980030400, rc 0) 00000100:00100000:0.0:1788535820.431085:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:5830:x1875415607045888:12345-0@lo:101: Request processed in 129us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535820.431092:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788535820.431243:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607045888:0@lo:101: 00010000:00010000:1.0:1788535820.431274:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535820.431285:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535820.431342:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607046016:0@lo:501: 00000100:00100000:1.0:1788535820.431371:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535820.431399:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986b41840 going to sleep for 11 seconds 00000100:00100000:0.0:1788535820.431762:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607046016 00000100:00100000:0.0:1788535820.431767:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607046016 00000100:00100000:0.0:1788535820.431801:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788535820.431809:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:5830:x1875415607046016:12345-0@lo:501: 00000100:00100000:0.0:1788535820.432155:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:5830:x1875415607046016:12345-0@lo:501: Request processed in 345us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535820.432163:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788535820.433125:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607046016:0@lo:501: 00000100:00100000:3.0:1788535820.433175:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607046144:0@lo:503: 00000100:00100000:3.0:1788535820.433239:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.433431:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860dda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535820.434966:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607046144 00000100:00100000:0.0:1788535820.434981:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607046144 00000100:00100000:0.0:1788535820.435118:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788535820.435131:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:5830:x1875415607046144:12345-0@lo:503: 00000100:00100000:0.0:1788535820.435435:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:5830:x1875415607046144:12345-0@lo:503: Request processed in 306us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535820.435444:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788535820.435554:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607046144:0@lo:503: 00000100:00100000:3.0:1788535820.436079:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8425:1875415607046272:0@lo:502: 00000100:00100000:3.0:1788535820.436131:0:8425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.436173:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860ddc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535820.436235:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607046272 00000100:00100000:2.0:1788535820.436241:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607046272 00000100:00100000:2.0:1788535820.436292:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788535820.436301:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:8425:x1875415607046272:12345-0@lo:502: 00000100:00100000:2.0:1788535820.436522:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:8425:x1875415607046272:12345-0@lo:502: Request processed in 222us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535820.436530:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788535820.436664:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8425:1875415607046272:0@lo:502: 00000100:00100000:3.0:1788535820.436711:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8425:1875415607046400:0@lo:502: 00000100:00100000:3.0:1788535820.436751:0:8425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.436779:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860ddc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535820.437400:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607046400 00000100:00100000:0.0:1788535820.437409:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607046400 00000100:00100000:0.0:1788535820.437454:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788535820.437473:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:8425:x1875415607046400:12345-0@lo:502: 00000100:00100000:0.0:1788535820.438662:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:8425:x1875415607046400:12345-0@lo:502: Request processed in 1184us (1902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535820.438673:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788535820.438924:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8425:1875415607046400:0@lo:502: 00000040:00080000:3.0:1788535820.438964:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788535820.439297:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788535820.439326:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788535820.439335:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.439346:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535820.439355:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788535820.439358:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788535820.439371:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788535820.439404:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.439412:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.439421:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535820.439451:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607046528:0@lo:101: 00000100:00100000:2.0:1788535820.439499:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.439546:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc780 going to sleep for 11 seconds 00000100:00100000:1.0:1788535820.439685:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607046528 00000100:00100000:1.0:1788535820.439693:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607046528 00000100:00100000:1.0:1788535820.439737:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788535820.439745:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+13:5830:x1875415607046528:12345-0@lo:101: 00010000:00010000:1.0:1788535820.439757:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535820.439770:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981652e00/0x74f51638375d3986 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d397f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535820.439804:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981652e00/0x74f51638375d3986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d397f expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535820.439814:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981652e00/0x74f51638375d3986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d397f expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535820.439822:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981652e00, rc 0) 00000100:00100000:1.0:1788535820.439874:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607046528:12345-0@lo:101: Request processed in 130us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535820.439881:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788535820.440075:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607046528:0@lo:101: 00010000:00010000:3.0:1788535820.440089:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.440098:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535820.440144:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607046656:0@lo:501: 00000100:00100000:3.0:1788535820.440171:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.440201:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860ddc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788535820.440434:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607046656 00000100:00100000:1.0:1788535820.440438:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607046656 00000100:00100000:1.0:1788535820.440468:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788535820.440474:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607046656:12345-0@lo:501: 00000100:00100000:1.0:1788535820.440734:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607046656:12345-0@lo:501: Request processed in 259us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535820.440741:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788535820.440865:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607046656:0@lo:501: 00000100:00100000:3.0:1788535820.440918:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607046784:0@lo:503: 00000100:00100000:3.0:1788535820.440961:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.440997:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860ddc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788535820.441801:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607046784 00000100:00100000:1.0:1788535820.441810:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607046784 00000100:00100000:1.0:1788535820.441843:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788535820.441850:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607046784:12345-0@lo:503: 00000100:00100000:1.0:1788535820.442084:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607046784:12345-0@lo:503: Request processed in 233us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535820.442091:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788535820.442686:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607046784:0@lo:503: 00000100:00100000:3.0:1788535820.443012:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8426:1875415607046912:0@lo:502: 00000100:00100000:3.0:1788535820.443055:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.443090:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860ddd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535820.443135:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607046912 00000100:00100000:0.0:1788535820.443140:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607046912 00000100:00100000:0.0:1788535820.443177:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788535820.443184:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:8426:x1875415607046912:12345-0@lo:502: 00000100:00100000:0.0:1788535820.443375:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:8426:x1875415607046912:12345-0@lo:502: Request processed in 190us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535820.443382:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788535820.444023:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8426:1875415607046912:0@lo:502: 00000020:01000000:3.0:1788535820.444052:0:8426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535820.444061:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535820.444064:0:8426:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788535820.444068:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788535820.444093:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8426:1875415607047040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535820.444140:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.444165:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860ddd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535820.444352:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607047040 00000100:00100000:2.0:1788535820.444358:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607047040 00000100:00100000:2.0:1788535820.444399:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788535820.444407:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:8426:x1875415607047040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535820.444591:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:8426:x1875415607047040:12345-0@lo:502:llog_process_th.0 Request processed in 184us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535820.444599:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788535820.444739:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8426:1875415607047040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788535820.444760:0:8426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535820.444765:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535820.444767:0:8426:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788535820.444770:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788535820.445290:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788535820.445311:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788535820.445322:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.445333:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535820.445343:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788535820.445353:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a9a7dac800 from 39 10000000:01000000:2.0:1788535820.445356:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788535820.445383:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.445392:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.445400:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535820.445419:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607047168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.445469:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.445504:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc780 going to sleep for 11 seconds 00000100:00100000:0.0:1788535820.445664:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607047168 00000100:00100000:0.0:1788535820.445669:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607047168 00000100:00100000:0.0:1788535820.445707:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788535820.445714:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:5830:x1875415607047168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535820.445724:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535820.445736:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a980030a00/0x74f51638375d3994 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d398d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535820.445754:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980030a00/0x74f51638375d3994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d398d expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535820.445763:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a980030a00/0x74f51638375d3994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d398d expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535820.445771:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980030a00, rc 0) 00000100:00100000:0.0:1788535820.445803:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607047168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535820.445819:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788535820.445998:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607047168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535820.446013:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.446022:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535820.446066:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607047296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.446091:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.446123:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc780 going to sleep for 11 seconds 00000100:00100000:3.0:1788535820.446186:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607047296 00000100:00100000:3.0:1788535820.446191:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607047296 00000100:00100000:3.0:1788535820.446224:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788535820.446231:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607047296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535820.446632:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607047296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 400us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535820.446639:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788535820.446762:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607047296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.446792:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607047424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.446828:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.446847:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc780 going to sleep for 11 seconds 00000100:00100000:3.0:1788535820.447192:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607047424 00000100:00100000:3.0:1788535820.447197:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607047424 00000100:00100000:3.0:1788535820.447231:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788535820.447237:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607047424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535820.447678:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607047424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 439us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535820.447686:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788535820.447834:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607047424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535820.448233:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f14700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8427:1875415607047552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535820.448350:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535820.448388:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986b41840 going to sleep for 11 seconds 00000100:00100000:2.0:1788535820.448499:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607047552 00000100:00100000:2.0:1788535820.448504:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607047552 00000100:00100000:2.0:1788535820.449052:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788535820.449064:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:8427:x1875415607047552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535820.449312:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:8427:x1875415607047552:12345-0@lo:502:llog_process_th.0 Request processed in 250us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535820.449320:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788535820.449399:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f14700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8427:1875415607047552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535820.449468:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8427:1875415607047680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535820.449507:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.450973:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860dd840 going to sleep for 11 seconds 00000100:00100000:0.0:1788535820.451138:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607047680 00000100:00100000:0.0:1788535820.451146:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607047680 00000100:00100000:0.0:1788535820.451182:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788535820.451190:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:8427:x1875415607047680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535820.451732:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:8427:x1875415607047680:12345-0@lo:502:llog_process_th.0 Request processed in 540us (2223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535820.451740:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788535820.451810:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8427:1875415607047680:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788535820.451839:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788535820.452092:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788535820.452109:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788535820.452118:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.452130:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535820.452139:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788535820.452141:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788535820.452144:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788535820.452171:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.452179:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.452188:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535820.452206:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607047808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.452249:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.452373:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535820.452419:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607047808 00000100:00100000:1.0:1788535820.452433:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607047808 00000100:00100000:0.0:1788535820.452595:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788535820.452604:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:5830:x1875415607047808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535820.452614:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535820.452626:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a980031400/0x74f51638375d39a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d399b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535820.452646:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980031400/0x74f51638375d39a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d399b expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535820.452656:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a980031400/0x74f51638375d39a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d399b expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535820.452665:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980031400, rc 0) 00000100:00100000:0.0:1788535820.452737:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607047808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535820.452743:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788535820.452853:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607047808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535820.452867:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.452875:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535820.453070:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607047936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.453094:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.453147:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535820.453176:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607047936 00000100:00100000:0.0:1788535820.453180:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607047936 00000100:00100000:0.0:1788535820.453234:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788535820.453249:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607047936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535820.453498:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607047936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535820.453506:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788535820.453570:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607047936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.453595:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607048064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.453627:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.457870:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535820.458052:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607048064 00000100:00100000:1.0:1788535820.458063:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607048064 00000100:00100000:1.0:1788535820.461355:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788535820.461379:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607048064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535820.461936:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607048064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 567us (8306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535820.461945:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788535820.462098:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607048064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535820.463022:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8428:1875415607048192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535820.463079:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535820.463118:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986b41c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788535820.463169:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607048192 00000100:00100000:3.0:1788535820.463177:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607048192 00000100:00100000:3.0:1788535820.463225:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788535820.463234:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:8428:x1875415607048192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535820.463446:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:8428:x1875415607048192:12345-0@lo:502:llog_process_th.0 Request processed in 213us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535820.463454:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788535820.463751:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8428:1875415607048192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788535820.463779:0:8428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535820.463788:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535820.463791:0:8428:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788535820.463808:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788535820.463833:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8428:1875415607048320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535820.463869:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535820.463916:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986b41c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788535820.463984:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607048320 00000100:00100000:3.0:1788535820.463990:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607048320 00000100:00100000:3.0:1788535820.464025:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788535820.464032:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:8428:x1875415607048320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535820.464166:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:8428:x1875415607048320:12345-0@lo:502:llog_process_th.0 Request processed in 134us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535820.464179:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788535820.464299:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8428:1875415607048320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788535820.464319:0:8428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788535820.464324:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535820.464326:0:8428:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788535820.464331:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788535820.464483:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788535820.464500:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788535820.464510:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.464521:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535820.464530:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788535820.464699:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a9ac46a000 from 39 10000000:01000000:3.0:1788535820.464703:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788535820.464731:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.464739:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.464748:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535820.464764:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607048448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788535820.464793:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.464824:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860dde40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535820.464865:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607048448 00000100:00100000:0.0:1788535820.464870:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607048448 00000100:00100000:0.0:1788535820.464926:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788535820.464934:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607048448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535820.464944:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535820.464958:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a980030e00/0x74f51638375d39b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d39a9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535820.464979:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980030e00/0x74f51638375d39b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d39a9 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535820.464990:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a980030e00/0x74f51638375d39b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d39a9 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535820.464998:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980030e00, rc 0) 00000100:00100000:0.0:1788535820.465033:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607048448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535820.465040:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788535820.465049:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607048448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535820.465062:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.465071:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535820.465116:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607048576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.465153:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.465174:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607048576 00000100:00100000:3.0:1788535820.465178:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607048576 00000100:00100000:2.0:1788535820.465189:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535820.465244:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788535820.465252:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607048576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535820.465490:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607048576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535820.465502:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788535820.465681:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607048576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.465710:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607048704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.465750:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.466059:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535820.466089:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607048704 00000100:00100000:1.0:1788535820.466093:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607048704 00000100:00100000:1.0:1788535820.466165:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788535820.466173:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607048704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535820.466337:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607048704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535820.466353:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788535820.466419:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607048704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535820.468636:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b27b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8429:1875415607048832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535820.468712:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.468762:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860dd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788535820.468865:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607048832 00000100:00100000:2.0:1788535820.468872:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607048832 00000100:00100000:2.0:1788535820.468934:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788535820.468943:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:8429:x1875415607048832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535820.469172:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:8429:x1875415607048832:12345-0@lo:502:llog_process_th.0 Request processed in 229us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535820.469180:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788535820.469287:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b27b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8429:1875415607048832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535820.469332:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b27b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8429:1875415607048960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535820.469366:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.469384:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860dd900 going to sleep for 11 seconds 00000100:00100000:0.0:1788535820.470650:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607048960 00000100:00100000:0.0:1788535820.470677:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607048960 00000100:00100000:0.0:1788535820.470719:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788535820.470727:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:8429:x1875415607048960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535820.471555:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:8429:x1875415607048960:12345-0@lo:502:llog_process_th.0 Request processed in 824us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535820.471566:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788535820.472015:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b27b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8429:1875415607048960:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788535820.472053:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788535820.473825:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788535820.473854:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788535820.473867:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.473881:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535820.474141:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788535820.474144:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788535820.474147:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788535820.474183:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.474193:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.474217:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535820.474244:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607049088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.474332:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.474382:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535820.474440:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607049088 00000100:00100000:3.0:1788535820.474449:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607049088 00000100:00100000:3.0:1788535820.474507:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788535820.474516:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607049088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535820.474530:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535820.474661:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a98ab4b000/0x74f51638375d39be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d39b7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.474686:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4b000/0x74f51638375d39be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d39b7 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.474698:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a98ab4b000/0x74f51638375d39be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d39b7 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.474719:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b000, rc 0) 00000100:00100000:3.0:1788535820.474768:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607049088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535820.474776:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788535820.474857:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607049088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535820.474872:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.474882:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535820.474963:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607049216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.474988:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.475056:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535820.475224:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607049216 00000100:00100000:1.0:1788535820.475230:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607049216 00000100:00100000:1.0:1788535820.475299:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788535820.475307:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607049216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535820.475635:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607049216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535820.475643:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788535820.475712:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607049216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.475742:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607049344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.475785:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.475871:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535820.475939:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607049344 00000100:00100000:3.0:1788535820.475945:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607049344 00000100:00100000:3.0:1788535820.475969:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788535820.475976:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607049344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535820.476123:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607049344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535820.476130:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788535820.476207:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607049344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.476520:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8430:1875415607049472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535820.476568:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.476598:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc540 going to sleep for 11 seconds 00000100:00100000:3.0:1788535820.476708:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607049472 00000100:00100000:3.0:1788535820.476713:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607049472 00000100:00100000:3.0:1788535820.476736:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788535820.476744:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:8430:x1875415607049472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535820.476938:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:8430:x1875415607049472:12345-0@lo:502:llog_process_th.0 Request processed in 195us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535820.476946:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788535820.477022:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8430:1875415607049472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535820.477046:0:8430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535820.477054:0:8430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535820.477057:0:8430:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788535820.477062:0:8430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788535820.477084:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8430:1875415607049600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535820.477117:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.477145:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc540 going to sleep for 11 seconds 00000100:00100000:3.0:1788535820.477188:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607049600 00000100:00100000:3.0:1788535820.477193:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607049600 00000100:00100000:3.0:1788535820.477212:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788535820.477218:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:8430:x1875415607049600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535820.477361:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:8430:x1875415607049600:12345-0@lo:502:llog_process_th.0 Request processed in 142us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535820.477368:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788535820.477537:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8430:1875415607049600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535820.477620:0:8430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535820.477624:0:8430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535820.477626:0:8430:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788535820.477629:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788535820.477789:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788535820.477814:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788535820.477823:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.477834:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535820.477844:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788535820.477847:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97a986be19c0 from 1 10000000:01000000:3.0:1788535820.477850:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788535820.477875:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d39c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.477884:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d39c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.477929:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d39c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535820.477945:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607049728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788535820.477976:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.477997:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9883df3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535820.478047:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607049728 00000100:00100000:2.0:1788535820.478051:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607049728 00000100:00100000:2.0:1788535820.478081:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788535820.478088:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607049728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535820.478097:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535820.478107:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b747ec00/0x74f51638375d39cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d39c5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.478128:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b747ec00/0x74f51638375d39cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d39c5 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.478139:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b747ec00/0x74f51638375d39cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d39c5 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535820.478147:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747ec00, rc 0) 00000100:00100000:2.0:1788535820.478185:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607049728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535820.478198:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788535820.478301:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607049728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535820.478314:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d39c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39cc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.478323:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d39c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d39cc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535820.478378:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607049856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535820.478405:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.478424:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9883df3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535820.478463:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607049856 00000100:00100000:2.0:1788535820.478467:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607049856 00000100:00100000:2.0:1788535820.478494:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788535820.478500:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607049856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535820.478810:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607049856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (402us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788535820.478817:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788535820.478873:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607049856:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788535820.478932:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788535820.478939:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d39c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39cc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.478946:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d39c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39cc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535820.557270:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535820.557294:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607049984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535820.557363:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535820.557409:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607049984 00000100:00100000:1.0:1788535820.557419:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607049984 00000100:00100000:1.0:1788535820.557473:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788535820.557484:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607049984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535820.557521:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535820.557582:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607049984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535820.557589:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788535820.557667:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b91eed80 x1875415607049984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535820.557687:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607049984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535820.734404:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535820.743651:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589196416 00000100:00100000:0.0:1788535820.743667:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589196416 00000100:00100000:0.0:1788535820.743793:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:0.0:1788535820.743805:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+8:5595:x1875415589196416:12345-192.168.203.12@tcp:101: 00010000:00010000:0.0:1788535820.743822:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535820.743844:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a980030200/0x74f51638375d39d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515587 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.744407:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980030200/0x74f51638375d39d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515587 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.744423:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a980030200/0x74f51638375d39d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515587 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535820.744433:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980030200, rc 0) 00000100:00100000:3.0:1788535820.744520:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:5595:x1875415589196416:12345-192.168.203.12@tcp:101: Request processed in 718us (10125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535820.744528:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:3.0:1788535820.748574:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535820.748688:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589196544 00000100:00100000:1.0:1788535820.748699:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589196544 00000100:00100000:1.0:1788535820.748751:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:1.0:1788535820.748761:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:5595:x1875415589196544:12345-192.168.203.12@tcp:501: 00000100:00100000:1.0:1788535820.749636:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:5595:x1875415589196544:12345-192.168.203.12@tcp:501: Request processed in 872us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535820.749645:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:0.0:1788535820.754606:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535820.756063:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589196672 00000100:00100000:3.0:1788535820.756081:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589196672 00000100:00100000:3.0:1788535820.756158:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:3.0:1788535820.756169:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:5595:x1875415589196672:12345-192.168.203.12@tcp:503: 00000100:00100000:3.0:1788535820.756412:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:5595:x1875415589196672:12345-192.168.203.12@tcp:503: Request processed in 243us (2532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535820.756420:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:3.0:1788535820.763290:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535820.763777:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589196800 00000100:00100000:1.0:1788535820.763790:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589196800 00000100:00100000:1.0:1788535820.763854:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:1.0:1788535820.763879:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:6068:x1875415589196800:12345-192.168.203.12@tcp:502: 00000100:00100000:1.0:1788535820.764200:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:6068:x1875415589196800:12345-192.168.203.12@tcp:502: Request processed in 321us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535820.764208:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:0.0:1788535820.766277:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535820.767999:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589196928 00000100:00100000:3.0:1788535820.768014:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589196928 00000100:00100000:3.0:1788535820.768087:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:3.0:1788535820.768097:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:6068:x1875415589196928:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788535820.768679:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:6068:x1875415589196928:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 580us (2418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535820.768689:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:2.0:1788535820.777080:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535820.777209:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589197056 00000100:00100000:1.0:1788535820.777221:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589197056 00000100:00100000:1.0:1788535820.777327:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:1.0:1788535820.777338:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:5595:x1875415589197056:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535820.777355:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535820.777373:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981652200/0x74f51638375d39da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751558e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535820.777403:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981652200/0x74f51638375d39da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751558e expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535820.777415:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981652200/0x74f51638375d39da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751558e expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535820.777425:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981652200, rc 0) 00000100:00100000:1.0:1788535820.779250:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5595:x1875415589197056:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 1903us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535820.779273:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:2.0:1788535820.783627:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535820.783717:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589197184 00000100:00100000:3.0:1788535820.783727:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589197184 00000100:00100000:3.0:1788535820.783788:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:3.0:1788535820.783798:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5595:x1875415589197184:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535820.784151:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5595:x1875415589197184:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 354us (535us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788535820.784160:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00010000:00010000:3.0:1788535821.197251:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788535822.018585:0:8467:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc841a7750 20000000:00000080:3.0:1788535822.018602:0:8467:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a9b734c000 uarg=0000000000000000 20000000:01000000:3.0:1788535822.018637:0:8467:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788535822.018643:0:8467:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788535822.018648:0:8467:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788535822.020429:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788535822.020851:0:8467:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788535822.030056:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788535822.030115:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788535822.030179:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788535822.030204:0:8467:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788535822.030224:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535822.030242:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a98ab4be00/0x74f51638375d3756 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d374f expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535822.030262:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981653c00/0x74f51638375d37b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d37b1 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535822.030270:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981652c00/0x74f51638375d3883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d387c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535822.030280:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a980031e00/0x74f51638375d3940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515556 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535822.030305:0:8467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535822.030347:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a980031e00/0x74f51638375d3940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515556 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535822.030363:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a980031e00/0x74f51638375d3940 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515556 expref: 9 pid: 5826 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535822.030377:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875415607050112:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535822.030481:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981652c00/0x74f51638375d3883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d387c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535822.030489:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a981652c00/0x74f51638375d3883 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d387c expref: 18 pid: 5826 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535822.030498:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d02a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875415607050240:0@lo:104: 00000100:00100000:2.0:1788535822.030546:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788535822.030584:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981653c00/0x74f51638375d37b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d37b1 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535822.030592:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a981653c00/0x74f51638375d37b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d37b1 expref: 18 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535822.030600:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875415607050368:0@lo:104: 00000100:00100000:2.0:1788535822.030622:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788535822.030649:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a98ab4be00/0x74f51638375d3756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d374f expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535822.030669:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a98ab4be00/0x74f51638375d3756 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d374f expref: 18 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535822.030677:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d00a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875415607050496:0@lo:104: 00000100:00100000:2.0:1788535822.030697:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc240 going to sleep for 11 seconds 00000100:00100000:2.0:1788535822.031316:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788535822.031338:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535822.031350:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607050240 00000100:00100000:2.0:1788535822.031359:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607050240 00000100:00100000:2.0:1788535822.031397:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607050368 00000100:00100000:2.0:1788535822.031401:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607050368 00000100:00100000:2.0:1788535822.031410:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607050496 00000100:00100000:2.0:1788535822.031413:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607050496 00000100:00100000:2.0:1788535822.031425:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788535822.031433:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:8467:x1875415607050240:12345-0@lo:104: 00010000:00010000:2.0:1788535822.031447:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3883 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535822.031566:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788535822.031573:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:8467:x1875415607050240:12345-0@lo:104: Request processed in 141us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535822.031579:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788535822.031597:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788535822.031604:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba236850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+4:8467:x1875415607050368:12345-0@lo:104: 00010000:00010000:2.0:1788535822.031612:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d37b8 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535822.031645:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788535822.031661:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba236850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+4:8467:x1875415607050368:12345-0@lo:104: Request processed in 57us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535822.031666:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788535822.031697:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788535822.031704:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:8467:x1875415607050496:12345-0@lo:104: 00010000:00010000:2.0:1788535822.031711:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a981652600/0x74f51638375d374f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3756 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535822.031873:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788535822.031879:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:8467:x1875415607050496:12345-0@lo:104: Request processed in 176us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535822.031907:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788535822.032023:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788535822.032031:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3883 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032038:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216ce00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:1.0:1788535822.032050:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d3883 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032057:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d3883 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535822.032064:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d3883 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535822.032070:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535822.032110:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3883 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032116:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535822.032137:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3883 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032144:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9c216ce00/0x74f51638375d387c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3883 expref: -99 pid: 7593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032158:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788535822.032161:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d37b8 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032167:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4ac00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:1.0:1788535822.032169:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d37b8 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032175:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d37b8 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535822.032191:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d37b8 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535822.032196:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535822.032210:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d37b8 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032215:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535822.032221:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d37b8 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032226:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a98ab4ac00/0x74f51638375d37b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d37b8 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032235:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535822.032237:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a981652600/0x74f51638375d374f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3756 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032242:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981652600 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:1.0:1788535822.032244:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a981652600/0x74f51638375d374f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d3756 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032261:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a981652600/0x74f51638375d374f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d3756 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535822.032267:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a981652600/0x74f51638375d374f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d3756 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535822.032272:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535822.032291:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a981652600/0x74f51638375d374f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3756 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032297:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535822.032312:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a981652600/0x74f51638375d374f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3756 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032318:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a981652600/0x74f51638375d374f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3756 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032331:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535822.032333:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535822.032335:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535822.032348:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607050624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535822.032383:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535822.032421:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535822.032427:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607050752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535822.032448:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535822.032474:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607050880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535822.032496:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535822.032535:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607050624 00000100:00100000:1.0:1788535822.032540:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607050624 00010000:00010000:1.0:1788535822.032564:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981652c00/0x74f51638375d3883 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d387c expref: 19 pid: 5826 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535822.032586:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607050752 00000100:00100000:1.0:1788535822.032589:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607050752 00010000:00010000:1.0:1788535822.032601:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981653c00/0x74f51638375d37b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d37b1 expref: 20 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535822.032626:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607050880 00000100:00100000:1.0:1788535822.032629:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607050880 00010000:00010000:1.0:1788535822.032641:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a98ab4be00/0x74f51638375d3756 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d374f expref: 21 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535822.032653:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788535822.032659:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+21:3308:x1875415607050624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788535822.032670:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535822.032675:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981652c00/0x74f51638375d3883 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d387c expref: 21 pid: 5826 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032684:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981652c00/0x74f51638375d3883 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d387c expref: 21 pid: 5826 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032700:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535822.032729:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+21:3308:x1875415607050624:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535822.032736:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788535822.032751:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788535822.032757:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+20:3308:x1875415607050752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788535822.032764:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535822.032769:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981653c00/0x74f51638375d37b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d37b1 expref: 20 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032776:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981653c00/0x74f51638375d37b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d37b1 expref: 20 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032786:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535822.032814:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+20:3308:x1875415607050752:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535822.032820:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788535822.032833:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788535822.032839:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607050880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788535822.032845:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535822.032849:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a98ab4be00/0x74f51638375d3756 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d374f expref: 19 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032856:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a98ab4be00/0x74f51638375d3756 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d374f expref: 19 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.032866:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535822.032914:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607050880:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535822.032921:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788535822.032962:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607050880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535822.032986:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607050752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535822.032992:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607050624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788535822.035976:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981652c00/0x74f51638375d3883 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d387c expref: 18 pid: 5826 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535822.035995:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d02a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875415607050240:0@lo:104: 00010000:00010000:3.0:1788535822.036010:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535822.036017:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535822.036106:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981653c00/0x74f51638375d37b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d37b1 expref: 17 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535822.036117:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875415607050368:0@lo:104: 00010000:00010000:3.0:1788535822.036127:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4be00/0x74f51638375d3756 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d374f expref: 16 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535822.036134:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d00a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875415607050496:0@lo:104: 00000100:00100000:3.0:1788535822.037765:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875415607050112:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535822.037794:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1788535822.037802:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535822.038050:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589197312 00000100:00100000:1.0:1788535822.038058:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589197312 00010000:00010000:1.0:1788535822.038097:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a980031e00/0x74f51638375d3940 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515556 expref: 10 pid: 5826 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535822.038148:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1788535822.038159:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2355:x1875415589197312:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535822.038173:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535822.038193:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a980031e00/0x74f51638375d3940 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515556 expref: 10 pid: 5826 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.038204:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a980031e00/0x74f51638375d3940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515556 expref: 10 pid: 5826 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.038221:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980031e00/0x74f51638375d3940 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515556 expref: 10 pid: 5826 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.038237:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.038245:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.038272:0:7598:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.038280:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.038287:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.038294:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.038300:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f000 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788535822.038304:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.038312:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.038340:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.038352:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535822.038412:0:8467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535822.038421:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535822.038437:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9b747f000/0x74f51638375d39e1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535822.038441:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:2355:x1875415589197312:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 284us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535822.038448:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00010000:00010000:1.0:1788535822.224759:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535822.508745:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535822.508923:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589197440 00000100:00100000:1.0:1788535822.508934:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589197440 00000100:00100000:1.0:1788535822.508997:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:1.0:1788535822.509008:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:5595:x1875415589197440:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535822.509025:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535822.509045:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981653200/0x74f51638375d39e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515595 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.509071:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981653200/0x74f51638375d39e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515595 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.509081:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981653200/0x74f51638375d39e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515595 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.509090:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981653200, rc 0) 00000100:00100000:1.0:1788535822.511385:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5595:x1875415589197440:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 2368us (2650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535822.511398:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:0.0:1788535822.522012:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535822.522114:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589197568 00000100:00100000:2.0:1788535822.522124:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589197568 00000100:00100000:2.0:1788535822.522180:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:2.0:1788535822.522190:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5595:x1875415589197568:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535822.522516:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5595:x1875415589197568:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 326us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535822.522525:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:0.0:1788535822.527118:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535822.527280:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589197696 00000100:00100000:1.0:1788535822.527304:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589197696 00000100:00100000:1.0:1788535822.527357:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:1.0:1788535822.527365:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5595:x1875415589197696:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535822.527573:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:5595:x1875415589197696:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 207us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535822.527580:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:0.0:1788535822.530009:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535822.530090:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589197824 00000100:00100000:3.0:1788535822.530105:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589197824 00000100:00100000:3.0:1788535822.530158:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:3.0:1788535822.530167:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:6125:x1875415589197824:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788535822.530422:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:6125:x1875415589197824:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 255us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535822.530431:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:0.0:1788535822.533669:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535822.535757:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589197952 00000100:00100000:2.0:1788535822.535771:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589197952 00000100:00100000:2.0:1788535822.535831:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:2.0:1788535822.535841:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:6125:x1875415589197952:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788535822.536073:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:6125:x1875415589197952:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 232us (2411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535822.536089:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 174 00010000:00010000:0.0:1788535823.248626:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788535823.888324:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788535823.888332:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a986ffc800 from 4 10000000:01000000:1.0:1788535823.888337:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788535823.888379:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.888391:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.888401:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535823.888425:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607051008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.888489:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.888535:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980ccb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.888561:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607051008 00000100:00100000:1.0:1788535823.888567:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607051008 00000100:00100000:1.0:1788535823.888615:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788535823.888624:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607051008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535823.888636:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535823.888648:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981653400/0x74f51638375d39f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d39ef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.888681:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981653400/0x74f51638375d39f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d39ef expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.888691:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981653400/0x74f51638375d39f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d39ef expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.888699:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981653400, rc 0) 00000100:00100000:1.0:1788535823.888732:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607051008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.888738:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788535823.888782:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607051008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535823.888795:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.888804:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d39f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535823.888852:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607051136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.888878:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.888922:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980ccb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.890590:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607051136 00000100:00100000:0.0:1788535823.890603:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607051136 00000100:00100000:0.0:1788535823.890655:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788535823.890665:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607051136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.891944:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607051136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1274us (3058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.891960:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788535823.892275:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607051136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.892337:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607051264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.892389:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.892428:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980ccb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.892520:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607051264 00000100:00100000:0.0:1788535823.892527:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607051264 00000100:00100000:0.0:1788535823.892570:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788535823.892579:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607051264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.892744:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607051264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.892751:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788535823.893740:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607051264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.895757:0:8555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8555:1875415607051392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535823.895832:0:8555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.895873:0:8555:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980ccb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.895993:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607051392 00000100:00100000:0.0:1788535823.896000:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607051392 00000100:00100000:0.0:1788535823.896048:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788535823.896057:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:8555:x1875415607051392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535823.896280:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:8555:x1875415607051392:12345-0@lo:502:llog_process_th.0 Request processed in 223us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.896288:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788535823.896411:0:8555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8555:1875415607051392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788535823.896440:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535823.896449:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535823.896451:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788535823.896470:0:8555:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a986ffc800 00000020:00000080:1.0:1788535823.896473:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788535823.896552:0:8555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8555:1875415607051520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535823.896588:0:8555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.896611:0:8555:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980ccb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.896716:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607051520 00000100:00100000:0.0:1788535823.896721:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607051520 00000100:00100000:0.0:1788535823.896752:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788535823.896758:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:8555:x1875415607051520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535823.896869:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:8555:x1875415607051520:12345-0@lo:502:llog_process_th.0 Request processed in 110us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.896875:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788535823.897260:0:8555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8555:1875415607051520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788535823.897283:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535823.897288:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535823.897290:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788535823.897298:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788535823.897820:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788535823.897844:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788535823.897854:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.897878:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535823.899286:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788535823.899291:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a9a7dac800 from 4 10000000:01000000:0.0:1788535823.899296:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788535823.899402:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.899414:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.899425:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535823.899446:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607051648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.899498:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.899539:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.900445:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607051648 00000100:00100000:1.0:1788535823.900457:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607051648 00000100:00100000:1.0:1788535823.900502:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788535823.900513:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986eda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607051648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535823.900527:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535823.900541:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981653600/0x74f51638375d3a04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d39fd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.900566:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981653600/0x74f51638375d3a04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d39fd expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.900592:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981653600/0x74f51638375d3a04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d39fd expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.900601:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981653600, rc 0) 00000100:00100000:1.0:1788535823.900659:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986eda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607051648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.900666:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788535823.901143:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607051648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535823.901161:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a04 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.901172:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3a04 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535823.901248:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607051776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.901283:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.901480:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.901556:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607051776 00000100:00100000:1.0:1788535823.901562:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607051776 00000100:00100000:1.0:1788535823.901590:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788535823.901598:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607051776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.901843:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607051776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.901850:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788535823.902067:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607051776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.902991:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607051904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.903051:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.903091:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.903393:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607051904 00000100:00100000:1.0:1788535823.903401:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607051904 00000100:00100000:1.0:1788535823.903439:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788535823.903447:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607051904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.903628:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607051904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.903636:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788535823.905422:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607051904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.909775:0:8557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91ef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8557:1875415607052032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535823.909855:0:8557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.909908:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607052032 00000100:00100000:0.0:1788535823.909915:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607052032 00000100:00100000:1.0:1788535823.909941:0:8557:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.910092:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788535823.910102:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:8557:x1875415607052032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535823.910319:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:8557:x1875415607052032:12345-0@lo:502:llog_process_th.0 Request processed in 218us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.910327:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788535823.912107:0:8557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91ef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8557:1875415607052032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788535823.912147:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535823.912156:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535823.912165:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788535823.912184:0:8557:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a9a7dac800 00000020:00000080:1.0:1788535823.912187:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788535823.912388:0:8557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8557:1875415607052160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535823.912449:0:8557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.912484:0:8557:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980ccd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.913069:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607052160 00000100:00100000:0.0:1788535823.913078:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607052160 00000100:00100000:0.0:1788535823.913140:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788535823.913491:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:8557:x1875415607052160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535823.913859:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:8557:x1875415607052160:12345-0@lo:502:llog_process_th.0 Request processed in 708us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.913868:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788535823.916060:0:8557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f15f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8557:1875415607052160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788535823.916107:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535823.916116:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535823.916119:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788535823.916138:0:8557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788535823.916576:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788535823.916599:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788535823.916609:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a04 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.916641:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a04 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535823.916651:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788535823.916654:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a9ac46a000 from 4 10000000:01000000:0.0:1788535823.916657:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788535823.916692:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.916700:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.916710:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535823.916730:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607052288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.916792:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.916831:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.917427:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607052288 00000100:00100000:1.0:1788535823.917437:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607052288 00000100:00100000:1.0:1788535823.917480:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788535823.917491:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607052288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535823.917505:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535823.917519:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981652c00/0x74f51638375d3a12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3a0b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.917543:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981652c00/0x74f51638375d3a12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3a0b expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.917553:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981652c00/0x74f51638375d3a12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3a0b expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.917561:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981652c00, rc 0) 00000100:00100000:1.0:1788535823.917606:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607052288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.917623:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788535823.917723:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607052288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535823.917737:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a12 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.917746:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3a12 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535823.917797:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607052416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.917828:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.917866:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.918271:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607052416 00000100:00100000:1.0:1788535823.918278:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607052416 00000100:00100000:0.0:1788535823.918866:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788535823.918878:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607052416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.919160:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607052416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.919168:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788535823.919210:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607052416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.919259:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607052544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.919298:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.920368:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.924665:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607052544 00000100:00100000:1.0:1788535823.924682:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607052544 00000100:00100000:1.0:1788535823.925198:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788535823.925214:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607052544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.925466:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607052544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 256us (6166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.925473:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788535823.925931:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607052544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.926646:0:8561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8561:1875415607052672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535823.926705:0:8561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.926742:0:8561:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.927751:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607052672 00000100:00100000:1.0:1788535823.927761:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607052672 00000100:00100000:1.0:1788535823.927802:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788535823.927810:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:8561:x1875415607052672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535823.928036:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:8561:x1875415607052672:12345-0@lo:502:llog_process_th.0 Request processed in 226us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.928044:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788535823.928543:0:8561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8561:1875415607052672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788535823.928572:0:8561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788535823.928581:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535823.928583:0:8561:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788535823.928591:0:8561:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a9ac46a000 00000020:00000080:0.0:1788535823.928594:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788535823.928680:0:8561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8561:1875415607052800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535823.928717:0:8561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.928742:0:8561:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98625c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.929686:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607052800 00000100:00100000:1.0:1788535823.929695:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607052800 00000100:00100000:1.0:1788535823.929729:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788535823.929736:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:8561:x1875415607052800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535823.929928:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:8561:x1875415607052800:12345-0@lo:502:llog_process_th.0 Request processed in 191us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.929935:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788535823.930498:0:8561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:8561:1875415607052800:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788535823.930525:0:8561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788535823.930535:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535823.930537:0:8561:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788535823.930542:0:8561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788535823.932255:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788535823.932286:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788535823.932299:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a12 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.932397:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a12 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535824.145442:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607052928:0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.145516:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535824.145581:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607053440:0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.145610:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535824.145643:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535824.145649:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607053312:0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.145671:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535824.145700:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607053056:0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.145726:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535824.145745:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535824.145751:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607053184:0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.145772:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535824.145849:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607053440 00000100:00100000:1.0:1788535824.145856:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607053440 00000100:00100000:1.0:1788535824.145928:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607053184 00000100:00100000:1.0:1788535824.145932:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607053184 00000100:00100000:1.0:1788535824.145954:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788535824.145963:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607053440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.146010:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607053440:12345-0@lo:400:kworker.0 Request processed in 48us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535824.146017:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788535824.146034:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788535824.146051:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607053184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.146084:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607053184:12345-0@lo:400:kworker.0 Request processed in 33us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535824.146090:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788535824.146108:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607052928 00000100:00100000:1.0:1788535824.146111:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607052928 00000100:00100000:1.0:1788535824.146130:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607053312 00000100:00100000:1.0:1788535824.146132:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607053312 00000100:00100000:1.0:1788535824.146141:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607053056 00000100:00100000:1.0:1788535824.146143:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607053056 00000100:00100000:1.0:1788535824.146154:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788535824.146160:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607052928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.146187:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607052928:12345-0@lo:400:kworker.0 Request processed in 28us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535824.146193:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788535824.146204:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788535824.146210:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607053312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.146247:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607053312:12345-0@lo:400:kworker.0 Request processed in 25us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535824.146520:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788535824.146534:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788535824.146540:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607053056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.146570:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607053056:12345-0@lo:400:kworker.0 Request processed in 31us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535824.146576:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788535824.146600:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788535824.146605:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788535824.146613:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788535824.146665:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9c0b25f80 x1875415607053184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535824.146681:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607053184:0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.146693:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607053056:0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.146723:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607053312:0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.146733:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607052928:0@lo:400:kworker.0 00010000:00080000:1.0:1788535824.146743:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9c0b24700 x1875415607053440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535824.146752:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607053440:0@lo:400:kworker.0 00010000:00010000:3.0:1788535824.269150:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535824.653397:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788535824.653421:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607053568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535824.653491:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535824.653673:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607053568 00000100:00100000:2.0:1788535824.653681:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607053568 00000100:00100000:2.0:1788535824.653731:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788535824.653740:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607053568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535824.653937:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788535824.654003:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607053568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 263us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535824.654011:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788535824.654383:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6d01180 x1875415607053568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535824.654402:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607053568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535824.757419:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535824.757476:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535824.757510:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589198208 00000100:00100000:0.0:1788535824.757519:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589198208 00000100:00100000:0.0:1788535824.757582:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:0.0:1788535824.757594:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2358:x1875415589198208:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535824.757670:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2358:x1875415589198208:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 78us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535824.757678:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00080000:0.0:1788535824.757699:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535824.757828:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589198080 00000100:00100000:2.0:1788535824.757832:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589198080 00000100:00100000:2.0:1788535824.757872:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:2.0:1788535824.757880:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2358:x1875415589198080:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535824.757937:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2358:x1875415589198080:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 58us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535824.757944:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:0.0:1788535824.763673:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535824.763728:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535824.763873:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589198336 00000100:00100000:0.0:1788535824.763881:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589198336 00000100:00100000:0.0:1788535824.763954:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589198464 00000100:00100000:0.0:1788535824.763958:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589198464 00000100:00100000:0.0:1788535824.763980:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788535824.763991:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589198336:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535824.764059:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589198336:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535824.764067:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788535824.764083:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788535824.764090:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589198464:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535824.764113:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589198464:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535824.764128:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00080000:0.0:1788535824.764156:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535824.764159:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788535825.294518:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535825.678091:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607053696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535825.678181:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535825.678339:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607053696 00000100:00100000:1.0:1788535825.678347:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607053696 00000100:00100000:1.0:1788535825.678395:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788535825.678403:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607053696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535825.678438:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535825.684532:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607053696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6119us (6359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535825.684547:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788535825.693212:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b91edf80 x1875415607053696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535825.693260:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607053696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788535826.317684:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535827.341043:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788535827.343773:0:8767:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788535828.365538:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535829.266716:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607054208:0@lo:400:kworker.0 00000100:00100000:2.0:1788535829.266730:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607053824:0@lo:400:kworker.0 00000100:00100000:2.0:1788535829.266801:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535829.266853:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607054336:0@lo:400:kworker.0 00000100:00100000:2.0:1788535829.266879:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.266931:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607054336 00000100:00100000:2.0:1788535829.266936:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788535829.266939:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607054336 00000100:00100000:2.0:1788535829.266941:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607053952:0@lo:400:kworker.0 00000100:00100000:2.0:1788535829.266963:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.266985:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607053952 00000100:00100000:1.0:1788535829.266988:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607053952 00000100:00100000:2.0:1788535829.266989:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607054464:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.267006:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788535829.267010:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.267016:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607054336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535829.267038:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607054080:0@lo:400:kworker.0 00000100:00100000:2.0:1788535829.267057:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.267066:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607054336:12345-0@lo:400:kworker.0 Request processed in 53us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535829.267079:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607054464 00000100:00100000:1.0:1788535829.267079:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788535829.267082:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607054464 00000100:00100000:1.0:1788535829.267094:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607054080 00000100:00100000:1.0:1788535829.267097:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607054080 00000100:00100000:2.0:1788535829.267109:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788535829.267109:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788535829.267114:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607054464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.267114:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607053952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535829.267141:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607054464:12345-0@lo:400:kworker.0 Request processed in 27us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.267141:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607053952:12345-0@lo:400:kworker.0 Request processed in 27us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535829.267148:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788535829.267148:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788535829.267159:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788535829.267165:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607054080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535829.267185:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607053952:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.267192:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607054080:12345-0@lo:400:kworker.0 Request processed in 28us (135us total) trans 0 rc 0/0 00010000:00080000:2.0:1788535829.267197:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6d02a00 x1875415607054464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535829.267209:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788535829.267219:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607054464:0@lo:400:kworker.0 00000100:00100000:2.0:1788535829.267229:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607054336:0@lo:400:kworker.0 00000100:00100000:2.0:1788535829.267256:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607054080:0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.267667:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607053824 00000100:00100000:0.0:1788535829.267672:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607053824 00000100:00100000:0.0:1788535829.267708:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788535829.267716:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607053824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.270635:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607053824:12345-0@lo:400:kworker.0 Request processed in 2909us (3823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535829.270651:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:0.0:1788535829.270709:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535829.270715:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535829.275390:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535829.276005:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607054208 00000100:00100000:0.0:1788535829.276017:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607054208 00000100:00100000:0.0:1788535829.276086:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788535829.276097:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607054208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.276163:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607054208:12345-0@lo:400:kworker.0 Request processed in 68us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535829.276170:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788535829.276193:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788535829.276567:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6d00a80 x1875415607054208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535829.276582:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607054208:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.276831:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607053824:0@lo:400:kworker.0 00010000:00010000:3.0:1788535829.390967:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535829.773553:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535829.773585:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607054592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535829.773651:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535829.775501:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607054592 00000100:00100000:0.0:1788535829.775515:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607054592 00000100:00100000:0.0:1788535829.775588:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788535829.775597:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607054592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535829.775632:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535829.775712:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607054592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535829.775726:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788535829.775774:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6d03800 x1875415607054592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535829.775794:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607054592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535829.887253:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535829.887299:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535829.887332:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535829.887357:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535829.887392:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589198976 00000100:00100000:0.0:1788535829.887401:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589198976 00000100:00100000:0.0:1788535829.887452:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589198848 00000100:00100000:0.0:1788535829.887456:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589198848 00000100:00100000:0.0:1788535829.887478:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788535829.887487:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2355:x1875415589198976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535829.887530:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589198720 00000100:00100000:1.0:1788535829.887537:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589198720 00000100:00100000:0.0:1788535829.887558:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2355:x1875415589198976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 71us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535829.887567:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788535829.887588:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1788535829.887597:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1788535829.887599:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2355:x1875415589198848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535829.887612:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589198720:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535829.887630:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2355:x1875415589198848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535829.887637:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1788535829.887659:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589198720:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 51us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535829.887659:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589198592 00000100:00100000:0.0:1788535829.887664:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589198592 00000100:00100000:1.0:1788535829.887670:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1788535829.887695:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:0.0:1788535829.887716:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2355:x1875415589198592:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535829.887745:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2355:x1875415589198592:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535829.887752:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00080000:0.0:1788535829.887780:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788535829.887785:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788535829.887786:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788535830.416359:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535830.797761:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607054720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535830.797831:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535830.797923:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607054720 00000100:00100000:1.0:1788535830.797938:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607054720 00000100:00100000:1.0:1788535830.797984:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788535830.797992:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607054720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535830.798028:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535830.798069:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607054720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535830.798077:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788535830.798117:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b930b100 x1875415607054720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535830.798136:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607054720:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788535831.438329:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788535831.647161:0:9012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing yml_node 00010000:00010000:0.0:1788535832.462581:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535833.487907:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535834.381228:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607055104:0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.381301:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535834.381358:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788535834.381380:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607055232:0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.381410:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535834.381451:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607055104 00000100:00100000:2.0:1788535834.381458:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607055104 00000100:00100000:2.0:1788535834.381509:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788535834.381519:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607055104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.381569:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607055104:12345-0@lo:400:kworker.0 Request processed in 52us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535834.381576:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788535834.381599:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607055232 00000100:00100000:2.0:1788535834.381603:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607055232 00000100:00100000:2.0:1788535834.381631:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788535834.381638:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607055232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.381668:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607055232:12345-0@lo:400:kworker.0 Request processed in 31us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535834.381674:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788535834.381689:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535834.381693:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788535834.381719:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6d03800 x1875415607055232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535834.381731:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607055232:0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.381742:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607055104:0@lo:400:kworker.0 00000100:00100000:3.0:1788535834.381827:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607054848:0@lo:400:kworker.0 00000100:00100000:3.0:1788535834.381863:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535834.382008:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607054848 00000100:00100000:0.0:1788535834.382071:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607054976:0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.382116:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607054848 00000100:00100000:2.0:1788535834.382147:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788535834.382154:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607054848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535834.382401:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607055360:0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.382815:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535834.382843:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607055488:0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.382883:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535834.382935:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607054976 00000100:00100000:0.0:1788535834.382939:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607054976 00000100:00100000:0.0:1788535834.382970:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788535834.382977:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607054976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.383017:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607054976:12345-0@lo:400:kworker.0 Request processed in 41us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535834.383024:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788535834.383062:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607055488 00000100:00100000:0.0:1788535834.383065:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607055488 00000100:00100000:0.0:1788535834.383092:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788535834.383098:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607055488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.383142:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607055488:12345-0@lo:400:kworker.0 Request processed in 44us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535834.383148:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788535834.383475:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607054976:0@lo:400:kworker.0 00010000:00080000:0.0:1788535834.383487:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6d00a80 x1875415607055488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535834.383495:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607055488:0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.384694:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607054848:12345-0@lo:400:kworker.0 Request processed in 2533us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535834.384705:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:2.0:1788535834.384746:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535834.384840:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535834.385008:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607054848:0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.385076:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607055360 00000100:00100000:2.0:1788535834.385082:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607055360 00000100:00100000:2.0:1788535834.385245:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788535834.385254:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607055360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.385305:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607055360:12345-0@lo:400:kworker.0 Request processed in 52us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535834.385311:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788535834.385337:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607055360:0@lo:400:kworker.0 00000100:00080000:3.0:1788535834.385472:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788535834.520301:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788535834.609121:0:9203:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.3 00000100:00100000:1.0:1788535834.893195:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607055616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535834.893287:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535834.893345:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607055616 00000100:00100000:0.0:1788535834.893354:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607055616 00000100:00100000:0.0:1788535834.893408:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788535834.893417:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607055616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535834.893450:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535834.893494:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607055616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535834.893501:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788535834.896816:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b91edc00 x1875415607055616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535834.896842:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607055616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535834.997325:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535834.997385:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535834.997457:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589199232 00000100:00100000:1.0:1788535834.997468:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589199232 00000100:00100000:2.0:1788535834.997542:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589199104 00000100:00100000:2.0:1788535834.997546:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589199104 00000100:00100000:1.0:1788535834.997564:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788535834.997574:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2358:x1875415589199232:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535834.997575:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:2.0:1788535834.997581:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2358:x1875415589199104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535834.997637:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2358:x1875415589199104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 55us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535834.997645:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00080000:3.0:1788535834.997653:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535835.002044:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2358:x1875415589199232:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 4458us (4645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535835.002060:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788535835.017904:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535835.018002:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535835.018098:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589199360 00000100:00100000:3.0:1788535835.018108:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589199360 00000100:00100000:3.0:1788535835.018245:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589199488 00000100:00100000:3.0:1788535835.018295:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589199488 00000100:00100000:3.0:1788535835.018325:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788535835.018339:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+5:2354:x1875415589199360:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:3.0:1788535835.018385:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d394e 00000100:00080000:3.0:1788535835.018396:0:8424:0:(import.c:65:import_set_state_nolock()) ffff97a9bf157000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788535835.018435:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788535835.019054:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+2:2354:x1875415589199360:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 715us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535835.019076:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788535835.019096:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788535835.019105:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+5:2354:x1875415589199488:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:3.0:1788535835.019124:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3955 00000100:00080000:3.0:1788535835.019132:0:8424:0:(import.c:65:import_set_state_nolock()) ffff97a9bf154800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788535835.019156:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788535835.019353:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+2:2354:x1875415589199488:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 249us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535835.019360:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00010000:00010000:3.0:1788535835.019383:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788535835.019510:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535835.019522:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788535835.019826:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535835.538276:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535835.917179:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607055744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535835.917251:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535835.917394:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607055744 00000100:00100000:1.0:1788535835.917403:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607055744 00000100:00100000:1.0:1788535835.917460:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788535835.917469:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607055744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535835.917515:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535835.917569:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607055744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535835.917576:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788535835.917653:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b9309180 x1875415607055744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535835.917674:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607055744:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788535836.569407:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788535836.861548:0:9301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.3 00000001:00100000:0.0:1788535837.489687:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 30a1922d-0d3f-4681-a966-cec3672631c6 00000020:00000080:0.0:1788535837.489698:0:6701:0:(genops.c:885:class_export_put()) final put ffff97a9bf156800/30a1922d-0d3f-4681-a966-cec3672631c6 00000020:00000080:2.0:1788535837.489936:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bf156800/30a1922d-0d3f-4681-a966-cec3672631c6 for lustre-OST0000 00000020:00000080:2.0:1788535837.489994:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9bf157000 for lustre-OST0000 00010000:00010000:0.0:1788535837.582311:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535838.610982:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788535838.893191:0:9399:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.3 00000100:00100000:0.0:1788535839.501094:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607056000:0@lo:400:kworker.0 00000100:00100000:2.0:1788535839.501145:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607056128:0@lo:400:kworker.0 00000100:00100000:2.0:1788535839.501189:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607056256:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.501200:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535839.501225:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535839.501285:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607056512:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.501313:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535839.501362:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788535839.501371:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607055872:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.501403:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535839.501453:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607056384:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.501488:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535839.501530:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607056256 00000100:00100000:0.0:1788535839.501544:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607056256 00000100:00100000:3.0:1788535839.501562:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607056512 00000100:00100000:3.0:1788535839.501569:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607056512 00000100:00100000:0.0:1788535839.501622:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788535839.501633:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607056256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.501694:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607056256:12345-0@lo:400:kworker.0 Request processed in 58us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535839.501702:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788535839.501721:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788535839.501728:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607056512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.501770:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607056512:12345-0@lo:400:kworker.0 Request processed in 42us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535839.501777:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788535839.501843:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6d00a80 x1875415607056256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535839.501857:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607056256:0@lo:400:kworker.0 00000100:00100000:2.0:1788535839.501926:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607055872 00000100:00100000:2.0:1788535839.501931:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607055872 00000100:00100000:2.0:1788535839.501955:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788535839.501961:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3311:x1875415607055872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535839.501991:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3311:x1875415607055872:12345-0@lo:400:kworker.0 Request processed in 30us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535839.501996:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788535839.502033:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788535839.502638:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535839.502644:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535839.505483:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607056000 00000100:00100000:2.0:1788535839.505494:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607056000 00000100:00100000:2.0:1788535839.505555:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607056384 00000100:00100000:2.0:1788535839.505558:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607056384 00000100:00100000:2.0:1788535839.505580:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607056128 00000100:00100000:2.0:1788535839.505584:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607056128 00000100:00100000:2.0:1788535839.505601:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788535839.505610:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607056000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535839.505685:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607056000:12345-0@lo:400:kworker.0 Request processed in 75us (4490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535839.505709:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788535839.505726:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788535839.505732:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607056384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535839.505985:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607056384:12345-0@lo:400:kworker.0 Request processed in 252us (4494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535839.505991:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788535839.506004:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788535839.506010:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607056128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535839.506051:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607056128:12345-0@lo:400:kworker.0 Request processed in 41us (4018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535839.506057:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788535839.506074:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535839.506106:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607056128:0@lo:400:kworker.0 00000100:00100000:2.0:1788535839.507478:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607055872:0@lo:400:kworker.0 00000100:00100000:2.0:1788535839.507504:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607056384:0@lo:400:kworker.0 00010000:00080000:2.0:1788535839.507521:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6d03480 x1875415607056512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535839.507531:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607056512:0@lo:400:kworker.0 00000100:00100000:2.0:1788535839.507544:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607056000:0@lo:400:kworker.0 00000001:00100000:1.0:1788535839.571788:0:7609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 30a1922d-0d3f-4681-a966-cec3672631c6 00000020:00000080:1.0:1788535839.571799:0:7609:0:(genops.c:885:class_export_put()) final put ffff97a9bf150800/30a1922d-0d3f-4681-a966-cec3672631c6 00000020:00000080:2.0:1788535839.573045:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bf150800/30a1922d-0d3f-4681-a966-cec3672631c6 for lustre-OST0001 00000020:00000080:2.0:1788535839.573148:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9bf154800 for lustre-OST0001 00010000:00010000:3.0:1788535839.629111:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535840.014088:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788535840.014112:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607056640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535840.014195:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535840.014373:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607056640 00000100:00100000:0.0:1788535840.014382:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607056640 00000100:00100000:0.0:1788535840.014452:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788535840.014462:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607056640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535840.014501:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535840.014559:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607056640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535840.014566:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788535840.020182:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b91eed80 x1875415607056640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535840.020226:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607056640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535840.115786:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535840.115831:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535840.115918:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589199616 00000100:00100000:3.0:1788535840.115929:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589199616 00000100:00100000:3.0:1788535840.115979:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:3.0:1788535840.115988:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2356:x1875415589199616:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535840.116060:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2356:x1875415589199616:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 72us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535840.116067:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:1.0:1788535840.118615:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589199744 00000100:00100000:1.0:1788535840.118627:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589199744 00000100:00100000:1.0:1788535840.118692:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:1.0:1788535840.118702:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589199744:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:2.0:1788535840.118836:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535840.118952:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589199744:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 250us (3118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535840.118960:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000001:02000400:3.0:1788535840.353363:0:9448:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 11:30:39 EDT 2026 00010000:00010000:0.0:1788535840.654915:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535841.040185:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535841.040208:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607056768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535841.040278:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535841.040499:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607056768 00000100:00100000:1.0:1788535841.040508:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607056768 00000100:00100000:1.0:1788535841.040571:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788535841.040580:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607056768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535841.040628:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535841.040674:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607056768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535841.040681:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788535841.040722:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b9308a80 x1875415607056768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535841.040740:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607056768:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788535841.040806:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788535841.678505:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535842.706076:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535843.725150:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535844.622760:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607056896:0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.622835:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535844.622880:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607057408:0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.622940:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535844.622967:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788535844.622973:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607057024:0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.622995:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535844.623013:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607057536:0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.623038:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535844.623067:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607057280:0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.623090:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535844.623122:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535844.623128:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875415607057152:0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.623162:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535844.623192:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607056896 00000100:00100000:2.0:1788535844.623199:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607056896 00000100:00100000:2.0:1788535844.623245:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788535844.623254:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607056896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.623301:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607056896:12345-0@lo:400:kworker.0 Request processed in 48us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535844.623317:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788535844.623818:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607057408 00000100:00100000:1.0:1788535844.623824:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607057408 00000100:00100000:1.0:1788535844.623862:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607057024 00000100:00100000:1.0:1788535844.623865:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607057024 00000100:00100000:1.0:1788535844.623877:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607057152 00000100:00100000:1.0:1788535844.623879:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607057152 00000100:00100000:1.0:1788535844.623909:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788535844.623916:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607057408:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788535844.624828:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535844.625148:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788535844.625161:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607057024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.627223:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607057408:12345-0@lo:400:kworker.0 Request processed in 3300us (4286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535844.627237:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788535844.627270:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788535844.627282:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875415607057152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.627335:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875415607057152:12345-0@lo:400:kworker.0 Request processed in 57us (4173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535844.627340:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788535844.627401:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875415607057152:0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.627682:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607057536 00000100:00100000:2.0:1788535844.627689:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607057536 00000100:00100000:2.0:1788535844.627733:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607057280 00000100:00100000:2.0:1788535844.627735:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607057280 00000100:00100000:2.0:1788535844.627752:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788535844.627759:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607057536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.627796:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607057536:12345-0@lo:400:kworker.0 Request processed in 39us (4757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535844.627802:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788535844.627814:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788535844.627819:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607057280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.627845:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607057280:12345-0@lo:400:kworker.0 Request processed in 26us (4754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535844.627850:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788535844.627873:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535844.627876:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788535844.627912:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b91a6300 x1875415607057536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535844.627923:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607057536:0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.627935:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607056896:0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.627944:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607057408:0@lo:400:kworker.0 00010000:00080000:1.0:1788535844.628196:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d06300 x1875415607057280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535844.628219:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607057280:0@lo:400:kworker.0 00000100:00100000:0.0:1788535844.628530:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607057024:12345-0@lo:400:kworker.0 Request processed in 3371us (5532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535844.628539:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788535844.628678:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607057024:0@lo:400:kworker.0 00010000:00010000:1.0:1788535844.750141:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535845.133184:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607057664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535845.133264:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535845.133568:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607057664 00000100:00100000:0.0:1788535845.133576:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607057664 00000100:00100000:0.0:1788535845.133630:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788535845.133640:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607057664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535845.133673:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535845.133716:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607057664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535845.133724:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788535845.133822:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b91a7100 x1875415607057664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535845.133841:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607057664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535845.236228:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535845.236274:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535845.236554:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589199872 00000100:00100000:0.0:1788535845.236565:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589199872 00000100:00100000:0.0:1788535845.236619:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:0.0:1788535845.236628:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2357:x1875415589199872:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535845.236689:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2357:x1875415589199872:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 62us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535845.236697:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:3.0:1788535845.237125:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589200000 00000100:00100000:3.0:1788535845.237131:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589200000 00000100:00100000:3.0:1788535845.237188:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1788535845.237197:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2357:x1875415589200000:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535845.237242:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2357:x1875415589200000:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 47us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535845.237249:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00080000:0.0:1788535845.239692:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788535845.777188:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535846.160518:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607057792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535846.160585:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535846.160676:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607057792 00000100:00100000:1.0:1788535846.160685:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607057792 00000100:00100000:1.0:1788535846.160755:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788535846.160765:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607057792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535846.160801:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535846.161435:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607057792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 669us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535846.161445:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788535846.161580:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf2aa300 x1875415607057792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535846.161602:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607057792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788535846.161609:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788535846.797151:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535847.824002:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535848.846289:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535849.744111:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607057920:0@lo:400:kworker.0 00000100:00100000:3.0:1788535849.744772:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607058304:0@lo:400:kworker.0 00000100:00100000:3.0:1788535849.744913:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535849.744973:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788535849.744980:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875415607058176:0@lo:400:kworker.0 00000100:00100000:3.0:1788535849.745039:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535849.745109:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607058176 00000100:00100000:3.0:1788535849.745244:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607058176 00000100:00100000:3.0:1788535849.745305:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788535849.745315:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875415607058176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535849.745367:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875415607058176:12345-0@lo:400:kworker.0 Request processed in 54us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535849.745374:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788535849.745398:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535849.745447:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875415607058176:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.745746:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535849.745790:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607058432:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.745814:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535849.745837:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788535849.745844:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607058048:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.745866:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535849.745898:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607058560:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.745922:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535849.745958:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607058304 00000100:00100000:2.0:1788535849.745962:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607058304 00000100:00100000:2.0:1788535849.745997:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607058560 00000100:00100000:2.0:1788535849.746001:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607058560 00000100:00100000:2.0:1788535849.746024:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788535849.746032:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607058304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.746084:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607058304:12345-0@lo:400:kworker.0 Request processed in 53us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535849.746091:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788535849.746311:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607057920 00000100:00100000:3.0:1788535849.746316:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607057920 00000100:00100000:3.0:1788535849.746346:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788535849.746353:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607057920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535849.746393:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607057920:12345-0@lo:400:kworker.0 Request processed in 41us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535849.746400:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788535849.746629:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788535849.746640:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607058560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.746674:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607058560:12345-0@lo:400:kworker.0 Request processed in 37us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535849.746681:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788535849.746704:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607058432 00000100:00100000:2.0:1788535849.746709:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607058432 00000100:00100000:2.0:1788535849.746738:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607058048 00000100:00100000:2.0:1788535849.746741:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607058048 00000100:00100000:2.0:1788535849.746759:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788535849.746765:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607058432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.746810:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607058432:12345-0@lo:400:kworker.0 Request processed in 45us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535849.746817:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788535849.746829:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788535849.746834:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607058048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.746862:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607058048:12345-0@lo:400:kworker.0 Request processed in 27us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535849.746867:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788535849.746921:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535849.746926:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535849.746928:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788535849.746961:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf2aaa00 x1875415607058304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535849.746975:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607058304:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.747009:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607058048:0@lo:400:kworker.0 00010000:00080000:2.0:1788535849.747035:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf2a9500 x1875415607058560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535849.747044:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607058560:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.747053:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607057920:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.747075:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607058432:0@lo:400:kworker.0 00010000:00010000:0.0:1788535849.876734:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535850.255765:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607058688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535850.255840:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535850.255969:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607058688 00000100:00100000:3.0:1788535850.255978:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607058688 00000100:00100000:3.0:1788535850.256028:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788535850.256037:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607058688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788535850.256083:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788535850.263726:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607058688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7680us (7875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535850.263741:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788535850.269380:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b91a5c00 x1875415607058688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535850.269409:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607058688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535850.367331:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535850.367370:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535850.367399:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589200256 00000100:00100000:3.0:1788535850.367409:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589200256 00000100:00100000:3.0:1788535850.367921:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1788535850.367935:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2357:x1875415589200256:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535850.368013:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2357:x1875415589200256:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 82us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535850.368021:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1788535850.368046:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589200128 00000100:00100000:3.0:1788535850.368076:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589200128 00000100:00100000:3.0:1788535850.368106:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:3.0:1788535850.368125:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2357:x1875415589200128:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535850.368153:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2357:x1875415589200128:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535850.368160:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00080000:3.0:1788535850.368188:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788535850.893122:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535851.277132:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607058816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535851.277205:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535851.277487:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607058816 00000100:00100000:2.0:1788535851.277496:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607058816 00000100:00100000:2.0:1788535851.277562:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788535851.277571:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607058816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788535851.277620:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788535851.277672:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607058816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535851.277679:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788535851.277693:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf2a9180 x1875415607058816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535851.277714:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607058816:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788535851.278073:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788535851.917351:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535852.943073:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535853.965004:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788535854.095665:0:10078:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 11:30:52 (1788535852) === 00000100:00100000:1.0:1788535854.567041:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535854.567127:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589200384 00000100:00100000:3.0:1788535854.567138:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589200384 00000100:00100000:3.0:1788535854.567205:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:3.0:1788535854.567216:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:8125:x1875415589200384:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788535854.567233:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535854.567250:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a98ab4ae00/0x74f51638375d3a19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751559c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535854.567276:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4ae00/0x74f51638375d3a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751559c expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535854.567288:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a98ab4ae00/0x74f51638375d3a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751559c expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535854.567296:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4ae00, rc 0) 00000100:00100000:3.0:1788535854.567354:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:8125:x1875415589200384:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 141us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535854.567377:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:3.0:1788535854.575746:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535854.576218:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589200512 00000100:00100000:0.0:1788535854.576230:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589200512 00000100:00100000:0.0:1788535854.576349:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:0.0:1788535854.576361:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:8125:x1875415589200512:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788535854.576680:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:8125:x1875415589200512:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 320us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535854.576689:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:2.0:1788535854.583454:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535854.583610:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589200640 00000100:00100000:0.0:1788535854.583621:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589200640 00000100:00100000:0.0:1788535854.583717:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:0.0:1788535854.583740:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:8125:x1875415589200640:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788535854.584014:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:8125:x1875415589200640:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 286us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535854.584022:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:1.0:1788535854.587876:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535854.587970:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589200768 00000100:00100000:0.0:1788535854.587982:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589200768 00000100:00100000:0.0:1788535854.588044:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:0.0:1788535854.588056:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:8129:x1875415589200768:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788535854.588391:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:8129:x1875415589200768:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 336us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535854.588409:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:1.0:1788535854.608064:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535854.608196:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589200896 00000100:00100000:3.0:1788535854.608207:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589200896 00000100:00100000:3.0:1788535854.608267:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:3.0:1788535854.608278:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:8129:x1875415589200896:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788535854.608548:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:8129:x1875415589200896:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 272us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535854.608556:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:2.0:1788535854.619047:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535854.619177:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589201024 00000100:00100000:0.0:1788535854.619188:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589201024 00000100:00100000:0.0:1788535854.619395:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:0.0:1788535854.619409:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:8125:x1875415589201024:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788535854.619439:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535854.619465:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9c2051a00/0x74f51638375d3a20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f975155c6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535854.619502:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9c2051a00/0x74f51638375d3a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155c6 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535854.619514:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9c2051a00/0x74f51638375d3a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155c6 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535854.619523:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c2051a00, rc 0) 00000100:00100000:0.0:1788535854.619593:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:8125:x1875415589201024:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 187us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535854.619601:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:1.0:1788535854.626044:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535854.626144:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589201152 00000100:00100000:0.0:1788535854.626155:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589201152 00000100:00100000:0.0:1788535854.626220:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:0.0:1788535854.626231:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:8125:x1875415589201152:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788535854.626511:0:5826:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788535854.626541:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788535854.626544:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788535854.626547:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788535854.626554:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788535854.636257:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:8125:x1875415589201152:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 10016us (10223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535854.636271:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:2.0:1788535854.644979:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535854.645135:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589201280 00000100:00100000:0.0:1788535854.645145:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589201280 00000100:00100000:0.0:1788535854.645204:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:0.0:1788535854.645215:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:8125:x1875415589201280:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788535854.645247:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535854.645265:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9c2050e00/0x74f51638375d3a27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f975155cd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535854.645296:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9c2050e00/0x74f51638375d3a27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155cd expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535854.645317:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9c2050e00/0x74f51638375d3a27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155cd expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535854.645327:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c2050e00, rc 0) 00000100:00100000:0.0:1788535854.645395:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:8125:x1875415589201280:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 181us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535854.645402:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:1.0:1788535854.647242:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535854.648576:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589201408 00000100:00100000:0.0:1788535854.648589:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589201408 00000100:00100000:0.0:1788535854.648657:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:0.0:1788535854.648668:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:8125:x1875415589201408:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788535854.649059:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:8125:x1875415589201408:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 391us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535854.649077:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:3.0:1788535854.655451:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535854.655605:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589201536 00000100:00100000:1.0:1788535854.655628:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589201536 00000100:00100000:1.0:1788535854.655685:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:1.0:1788535854.655695:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:8125:x1875415589201536:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788535854.655961:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:8125:x1875415589201536:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 266us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535854.655969:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:2.0:1788535854.660182:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535854.660379:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589201664 00000100:00100000:3.0:1788535854.660391:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589201664 00000100:00100000:3.0:1788535854.660464:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:3.0:1788535854.660475:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:8134:x1875415589201664:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788535854.660740:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:8134:x1875415589201664:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 266us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535854.660748:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:2.0:1788535854.666791:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535854.667002:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589201792 00000100:00100000:0.0:1788535854.667012:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589201792 00000100:00100000:0.0:1788535854.667123:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:0.0:1788535854.667135:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:8134:x1875415589201792:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788535854.667471:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:8134:x1875415589201792:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 336us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535854.667480:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:0.0:1788535854.679064:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535854.679104:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535854.679196:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589202304 00000100:00100000:2.0:1788535854.679206:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589202304 00000100:00100000:2.0:1788535854.679287:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589201920 00000100:00100000:2.0:1788535854.679291:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589201920 00000100:00100000:1.0:1788535854.679426:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:1.0:1788535854.679450:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2358:x1875415589202304:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535854.679539:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2358:x1875415589202304:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 93us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535854.679547:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:1.0:1788535854.679577:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1788535854.679583:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2354:x1875415589201920:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788535854.679604:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 71ebecc8-0d84-4b23-8d21-de56113948a9@192.168.203.12@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:1.0:1788535854.679639:0:5832:0:(genops.c:1385:class_connect()) connect: client 71ebecc8-0d84-4b23-8d21-de56113948a9, cookie 0x74f51638375d3a2e 00000004:00100000:1.0:1788535854.679670:0:5832:0:(mdt_handler.c:7337:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788535854.680793:0:5832:0:(import.c:65:import_set_state_nolock()) ffff97a9b6d5d800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788535854.680957:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535854.681166:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+6:2354:x1875415589201920:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 1579us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535854.681175:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788535854.686669:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535854.686996:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535854.691338:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589202048 00000100:00100000:2.0:1788535854.691355:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589202048 00000100:00100000:2.0:1788535854.691450:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589202176 00000100:00100000:2.0:1788535854.691454:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589202176 00000100:00100000:2.0:1788535854.691744:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1788535854.691757:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ebecc8-0d84-4b23-8d21-de56113948a9+7:0:x1875415589202048:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788535854.691799:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1788535854.692002:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535854.692113:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ebecc8-0d84-4b23-8d21-de56113948a9+7:0:x1875415589202048:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 358us (5453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535854.692254:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788535854.692265:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ebecc8-0d84-4b23-8d21-de56113948a9+7:8125:x1875415589202176:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788535854.692280:0:6697:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788535854.692316:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ebecc8-0d84-4b23-8d21-de56113948a9+7:8125:x1875415589202176:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 53us (5320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535854.692331:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1788535854.692782:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1788535854.703402:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535854.705696:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589202432 00000100:00100000:1.0:1788535854.705714:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589202432 00000100:00100000:1.0:1788535854.705834:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788535854.705845:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ebecc8-0d84-4b23-8d21-de56113948a9+6:8125:x1875415589202432:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788535854.705961:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ebecc8-0d84-4b23-8d21-de56113948a9+6:8125:x1875415589202432:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 117us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535854.705969:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788535854.711668:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535854.711768:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589202816 00000100:00100000:3.0:1788535854.711777:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589202816 00000100:00100000:3.0:1788535854.711839:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1788535854.711849:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+6:8125:x1875415589202816:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788535854.712163:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788535854.712288:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+6:8125:x1875415589202816:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 440us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535854.712314:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:2.0:1788535854.715846:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535854.715954:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535854.716960:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589202560 00000100:00100000:0.0:1788535854.716972:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589202560 00000100:00100000:0.0:1788535854.717017:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589202688 00000100:00100000:0.0:1788535854.717021:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589202688 00000100:00100000:0.0:1788535854.717052:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788535854.717060:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1875415589202560:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788535854.717089:0:6674:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 71ebecc8-0d84-4b23-8d21-de56113948a9@192.168.203.12@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1788535854.717120:0:6674:0:(genops.c:1385:class_connect()) connect: client 71ebecc8-0d84-4b23-8d21-de56113948a9, cookie 0x74f51638375d3a35 00002000:00100000:0.0:1788535854.717132:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 71ebecc8-0d84-4b23-8d21-de56113948a9/ffff97a9bfd10800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788535854.717156:0:6674:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788535854.717673:0:6674:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788535854.717719:0:6674:0:(import.c:65:import_set_state_nolock()) ffff97a9bfd16800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788535854.718657:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+6:2354:x1875415589202560:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 1591us (2815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535854.718668:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788535854.718697:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1788535854.718703:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1875415589202688:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788535854.718724:0:6674:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 71ebecc8-0d84-4b23-8d21-de56113948a9@192.168.203.12@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1788535854.718751:0:6674:0:(genops.c:1385:class_connect()) connect: client 71ebecc8-0d84-4b23-8d21-de56113948a9, cookie 0x74f51638375d3a3c 00002000:00100000:0.0:1788535854.718760:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 71ebecc8-0d84-4b23-8d21-de56113948a9/ffff97a9bfd13800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788535854.718778:0:6674:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788535854.719010:0:6674:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788535854.719043:0:6674:0:(import.c:65:import_set_state_nolock()) ffff97a9bfd15000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788535854.719073:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+6:2354:x1875415589202688:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 369us (3119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535854.719080:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788535854.862334:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607059072:0@lo:400:kworker.0 00000100:00100000:3.0:1788535854.862402:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607059200:0@lo:400:kworker.0 00000100:00100000:2.0:1788535854.862410:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535854.862465:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535854.862471:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607058944:0@lo:400:kworker.0 00000100:00100000:1.0:1788535854.864535:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607059072 00000100:00100000:1.0:1788535854.864561:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607059072 00000100:00100000:1.0:1788535854.864610:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788535854.864620:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607059072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535854.866462:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607059328:0@lo:400:kworker.0 00000100:00100000:2.0:1788535854.868322:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535854.868415:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607059584:0@lo:400:kworker.0 00000100:00100000:2.0:1788535854.868475:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535854.868690:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535854.868699:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607059456:0@lo:400:kworker.0 00000100:00100000:2.0:1788535854.868725:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535854.869032:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607059456 00000100:00100000:2.0:1788535854.869042:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607059456 00000100:00100000:2.0:1788535854.869220:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788535854.869231:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607059456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535854.869289:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607059456:12345-0@lo:400:kworker.0 Request processed in 60us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535854.869311:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788535854.869332:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535854.869346:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607059584 00000100:00100000:2.0:1788535854.869350:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607059584 00000100:00100000:2.0:1788535854.869379:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788535854.869385:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607059584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535854.869416:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607059584:12345-0@lo:400:kworker.0 Request processed in 32us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535854.869422:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788535854.869439:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788535854.869465:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607059456:0@lo:400:kworker.0 00010000:00080000:2.0:1788535854.869478:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9c0b24a80 x1875415607059584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535854.869488:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607059584:0@lo:400:kworker.0 00000100:00100000:1.0:1788535854.870505:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607059072:12345-0@lo:400:kworker.0 Request processed in 5880us (8089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535854.870516:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788535854.870642:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607058944 00000100:00100000:1.0:1788535854.870650:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607058944 00000100:00100000:1.0:1788535854.870695:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788535854.870704:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3311:x1875415607058944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535854.870713:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535854.870757:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3311:x1875415607058944:12345-0@lo:400:kworker.0 Request processed in 55us (2441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535854.870763:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607059200 00000100:00100000:1.0:1788535854.870766:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788535854.870769:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607059200 00000100:00100000:3.0:1788535854.870819:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788535854.870828:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607059200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535854.870950:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607059200:12345-0@lo:400:kworker.0 Request processed in 123us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535854.870957:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788535854.870991:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607059200:0@lo:400:kworker.0 00000100:00080000:3.0:1788535854.871091:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535854.877346:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535854.877399:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607059328 00000100:00100000:0.0:1788535854.877408:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607059328 00000100:00100000:0.0:1788535854.877476:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788535854.877487:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607059328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535854.877728:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607059328:12345-0@lo:400:kworker.0 Request processed in 244us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535854.877814:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788535854.877837:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788535854.879600:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9c0b25500 x1875415607059328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535854.879619:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607059328:0@lo:400:kworker.0 00000100:00100000:3.0:1788535854.880270:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607058944:0@lo:400:kworker.0 00000100:00100000:3.0:1788535854.880287:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607059072:0@lo:400:kworker.0 00000001:00100000:0.0:1788535854.923999:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 71ebecc8-0d84-4b23-8d21-de56113948a9 00000001:00100000:3.0:1788535854.950446:0:7609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 71ebecc8-0d84-4b23-8d21-de56113948a9 00010000:00010000:0.0:1788535854.989342:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535855.373701:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607059712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535855.373783:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535855.378297:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607059712 00000100:00100000:2.0:1788535855.378312:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607059712 00000100:00100000:2.0:1788535855.378388:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788535855.378400:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607059712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535855.378430:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788535855.378532:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607059712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (4749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535855.378540:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788535855.378753:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b91a6d80 x1875415607059712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535855.378776:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607059712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788535856.015785:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535856.398507:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607059840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535856.398646:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535856.416411:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607059840 00000100:00100000:2.0:1788535856.416426:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607059840 00000100:00100000:2.0:1788535856.416511:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788535856.416531:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607059840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788535856.416743:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788535856.416957:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607059840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 428us (18312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535856.416965:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788535856.418293:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788535856.420113:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf2a8e00 x1875415607059840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535856.420141:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607059840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788535857.039000:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788535858.010322:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 71ebecc8-0d84-4b23-8d21-de56113948a9 00010000:00010000:2.0:1788535858.061123:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535859.085106:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788535859.971861:0:10277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788535859.983976:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607059968:0@lo:400:kworker.0 00000100:00100000:3.0:1788535859.984025:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607060096:0@lo:400:kworker.0 00000100:00100000:2.0:1788535859.984054:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535859.984058:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535859.984107:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607060608:0@lo:400:kworker.0 00000100:00100000:2.0:1788535859.984107:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607060480:0@lo:400:kworker.0 00000100:00100000:2.0:1788535859.984129:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535859.984165:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607060096 00000100:00100000:2.0:1788535859.984173:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607060096 00000100:00100000:3.0:1788535859.984179:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607060224:0@lo:400:kworker.0 00000100:00100000:3.0:1788535859.984202:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535859.984209:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607060480 00000100:00100000:2.0:1788535859.984211:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607060480 00000100:00100000:3.0:1788535859.984218:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535859.984223:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607060352:0@lo:400:kworker.0 00000100:00100000:2.0:1788535859.984233:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607060224 00000100:00100000:2.0:1788535859.984236:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607060224 00000100:00100000:3.0:1788535859.984244:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535859.984251:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788535859.984258:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607060096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535859.984271:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788535859.984278:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607060480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535859.984301:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607060096:12345-0@lo:400:kworker.0 Request processed in 42us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535859.984303:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607060480:12345-0@lo:400:kworker.0 Request processed in 27us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535859.984308:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788535859.984372:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788535859.984376:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788535859.984384:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607060224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535859.984403:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607060352 00000100:00100000:3.0:1788535859.984407:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607060352 00000100:00100000:2.0:1788535859.984421:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607060224:12345-0@lo:400:kworker.0 Request processed in 38us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535859.984437:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788535859.984438:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788535859.984443:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607060352:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788535859.984454:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535859.984458:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535859.984472:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607060352:12345-0@lo:400:kworker.0 Request processed in 29us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535859.984478:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788535859.984509:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf2ab800 x1875415607060352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535859.984535:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607060352:0@lo:400:kworker.0 00000100:00100000:3.0:1788535859.984549:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607060224:0@lo:400:kworker.0 00000100:00100000:0.0:1788535859.984582:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607059968 00000100:00100000:3.0:1788535859.984586:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607060480:0@lo:400:kworker.0 00000100:00100000:0.0:1788535859.984589:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607059968 00000100:00100000:2.0:1788535859.984610:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535859.984671:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607060096:0@lo:400:kworker.0 00000100:00100000:3.0:1788535859.984694:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607060608 00000100:00100000:3.0:1788535859.984697:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607060608 00000100:00100000:3.0:1788535859.984724:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788535859.984730:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b737b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607060608:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788535859.984733:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788535859.984817:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b737b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607060608:12345-0@lo:400:kworker.0 Request processed in 86us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535859.984824:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788535859.984873:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b74d0700 x1875415607060608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535859.984883:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607060608:0@lo:400:kworker.0 00000100:00100000:0.0:1788535859.985672:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788535859.985754:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607059968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535859.985808:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607059968:12345-0@lo:400:kworker.0 Request processed in 124us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535859.985815:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788535859.985860:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607059968:0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.093774:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535860.093854:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535860.093912:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535860.093936:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535860.093962:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535860.094000:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589203456 00000100:00100000:2.0:1788535860.094009:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589203456 00000100:00100000:2.0:1788535860.094062:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589203328 00000100:00100000:2.0:1788535860.094065:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589203328 00000100:00100000:2.0:1788535860.094089:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:2.0:1788535860.094097:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2357:x1875415589203456:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535860.094162:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2357:x1875415589203456:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 64us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535860.094180:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:2.0:1788535860.094198:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:2.0:1788535860.094204:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2357:x1875415589203328:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535860.094229:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2357:x1875415589203328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535860.094235:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:2.0:1788535860.094253:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589203200 00000100:00100000:2.0:1788535860.094257:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589203200 00000100:00100000:2.0:1788535860.094279:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589203072 00000100:00100000:2.0:1788535860.094282:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589203072 00000100:00100000:2.0:1788535860.094300:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1788535860.094306:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b737a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2357:x1875415589203200:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535860.094332:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b737a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2357:x1875415589203200:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535860.094338:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1788535860.094349:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1788535860.094355:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2357:x1875415589203072:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535860.094375:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2357:x1875415589203072:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535860.094381:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00080000:2.0:1788535860.094399:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535860.094403:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535860.094405:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788535860.099191:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589202944 00000100:00100000:1.0:1788535860.099207:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589202944 00000100:00100000:3.0:1788535860.099569:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:3.0:1788535860.099582:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2357:x1875415589202944:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535860.099669:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2357:x1875415589202944:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 89us (5903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535860.099677:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 215 00010000:00010000:1.0:1788535860.109220:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535860.495842:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607060736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535860.496199:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535860.497725:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607060736 00000100:00100000:2.0:1788535860.497740:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607060736 00000100:00100000:2.0:1788535860.497825:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788535860.497836:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607060736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535860.497878:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788535860.498147:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607060736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 311us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535860.498157:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788535860.498165:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b930ad80 x1875415607060736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535860.498188:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607060736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788535861.137203:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535861.519528:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535861.519557:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607060864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535861.519637:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535861.519844:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607060864 00000100:00100000:1.0:1788535861.519853:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607060864 00000100:00080000:3.0:1788535861.519907:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788535861.519936:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788535861.519945:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788535861.519955:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788535861.519960:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607060864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535861.520005:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535861.520063:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607060864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535861.520071:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788535861.523257:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b7378380 x1875415607060864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535861.523289:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607060864:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788535862.158301:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535863.182733:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535864.205181:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535865.101376:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607060992:0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.101465:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535865.101496:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b737a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607061248:0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.101526:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607061504:0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.101560:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535865.101570:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b737b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607061376:0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.101613:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607061120:0@lo:400:kworker.0 00000100:00100000:3.0:1788535865.101789:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607061248 00000100:00100000:3.0:1788535865.101799:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607061248 00000100:00100000:3.0:1788535865.102234:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788535865.102245:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607061248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535865.102882:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535865.102995:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535865.103025:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b737b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607061632:0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.103054:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535865.103101:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607061504 00000100:00100000:0.0:1788535865.103107:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607061504 00000100:00100000:0.0:1788535865.103139:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607061120 00000100:00100000:0.0:1788535865.103142:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607061120 00000100:00100000:0.0:1788535865.103156:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788535865.103163:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607061504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.103204:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607061504:12345-0@lo:400:kworker.0 Request processed in 41us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535865.103211:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788535865.103226:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788535865.103246:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607061120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.103625:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607061120:12345-0@lo:400:kworker.0 Request processed in 378us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535865.103633:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788535865.103678:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607061120:0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.103718:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607061632 00000100:00100000:0.0:1788535865.103722:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607061632 00000100:00100000:0.0:1788535865.103755:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788535865.103761:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607061632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.103797:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607061632:12345-0@lo:400:kworker.0 Request processed in 37us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535865.103805:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788535865.103833:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b737b800 x1875415607061632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535865.103844:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b737b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607061632:0@lo:400:kworker.0 00000100:00080000:0.0:1788535865.103873:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535865.103877:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535865.103919:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607060992 00000100:00100000:0.0:1788535865.103923:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607060992 00000100:00100000:0.0:1788535865.103950:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788535865.103968:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607060992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.104003:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607060992:12345-0@lo:400:kworker.0 Request processed in 37us (2540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535865.104009:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788535865.109553:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535865.109669:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607061376 00000100:00100000:0.0:1788535865.109679:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607061376 00000100:00100000:0.0:1788535865.109756:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788535865.109765:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b737aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607061376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535865.110770:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607061248:12345-0@lo:400:kworker.0 Request processed in 8520us (9203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535865.110783:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788535865.111174:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b737aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607061376:12345-0@lo:400:kworker.0 Request processed in 1409us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535865.111182:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788535865.111203:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535865.111604:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b737a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607061248:0@lo:400:kworker.0 00010000:00080000:2.0:1788535865.115394:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b737b100 x1875415607061376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535865.115415:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b737b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607061376:0@lo:400:kworker.0 00000100:00100000:1.0:1788535865.116798:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607061504:0@lo:400:kworker.0 00000100:00100000:1.0:1788535865.116832:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607060992:0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.206065:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535865.206108:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535865.206141:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535865.206178:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535865.206201:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535865.206283:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589204096 00000100:00100000:1.0:1788535865.206293:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589204096 00000100:00100000:1.0:1788535865.206355:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589203968 00000100:00100000:1.0:1788535865.206358:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589203968 00000100:00100000:1.0:1788535865.206382:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788535865.206393:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2355:x1875415589204096:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535865.206477:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2355:x1875415589204096:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 86us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535865.206487:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788535865.206496:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788535865.206511:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2355:x1875415589203968:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535865.206560:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2355:x1875415589203968:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 54us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535865.206576:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788535865.206605:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589203840 00000100:00100000:0.0:1788535865.206610:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589203840 00000100:00100000:0.0:1788535865.206641:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589203712 00000100:00100000:0.0:1788535865.206644:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589203712 00000100:00100000:0.0:1788535865.206664:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:0.0:1788535865.206671:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b737b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2355:x1875415589203840:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535865.206708:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b737b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2355:x1875415589203840:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 37us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535865.206717:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:1.0:1788535865.206725:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:1.0:1788535865.206735:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589203712:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535865.206763:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589203712:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535865.206770:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:3.0:1788535865.206867:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589203584 00000100:00100000:3.0:1788535865.206872:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589203584 00000100:00100000:0.0:1788535865.207005:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:0.0:1788535865.207014:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2355:x1875415589203584:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535865.207054:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2355:x1875415589203584:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 42us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535865.207061:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00080000:2.0:1788535865.207142:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535865.207147:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535865.207150:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788535865.229103:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535865.613182:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535865.613217:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607061760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535865.613291:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535865.613393:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607061760 00000100:00100000:1.0:1788535865.613401:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607061760 00000100:00100000:1.0:1788535865.613455:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788535865.613465:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b737ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607061760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535865.613497:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535865.613540:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b737ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607061760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535865.613547:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788535865.613618:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b930b480 x1875415607061760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535865.613636:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607061760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788535866.253134:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535866.645628:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535866.645649:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607061888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535866.645715:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535866.646325:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607061888 00000100:00100000:1.0:1788535866.646335:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607061888 00000100:00100000:1.0:1788535866.646382:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788535866.646392:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607061888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535866.646424:0:10342:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535866.646477:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607061888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535866.646484:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788535866.646528:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b91a5880 x1875415607061888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535866.646549:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607061888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788535867.277089:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535868.304714:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535869.332135:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535870.221279:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607062272:0@lo:400:kworker.0 00000100:00100000:3.0:1788535870.221345:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.221471:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607062016:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.221509:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.221537:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607062528:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.221558:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.221581:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788535870.221587:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607062144:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.221608:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.221629:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607062656:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.221655:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.221682:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607062400:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.221721:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.221750:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607062272 00000100:00100000:2.0:1788535870.221757:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607062272 00000100:00100000:2.0:1788535870.221804:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607062528 00000100:00100000:2.0:1788535870.221807:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607062528 00000100:00100000:2.0:1788535870.221819:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607062144 00000100:00100000:2.0:1788535870.221822:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607062144 00000100:00100000:2.0:1788535870.221838:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788535870.221846:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607062272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.221932:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607062272:12345-0@lo:400:kworker.0 Request processed in 87us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.221950:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788535870.221966:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788535870.221972:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b737bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607062528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.222006:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b737bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607062528:12345-0@lo:400:kworker.0 Request processed in 33us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.222017:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788535870.222029:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788535870.222034:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607062144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.222254:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607062144:12345-0@lo:400:kworker.0 Request processed in 219us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.222261:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788535870.222281:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607062656 00000100:00100000:2.0:1788535870.222286:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607062656 00000100:00100000:2.0:1788535870.222311:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607062400 00000100:00100000:2.0:1788535870.222314:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607062400 00000100:00100000:2.0:1788535870.222334:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788535870.222341:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607062656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.222372:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607062656:12345-0@lo:400:kworker.0 Request processed in 32us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.222379:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788535870.222554:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788535870.222562:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607062400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.222596:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607062400:12345-0@lo:400:kworker.0 Request processed in 36us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.222602:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788535870.222857:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607062016 00000100:00100000:0.0:1788535870.222861:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607062016 00000100:00100000:0.0:1788535870.223117:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788535870.223125:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607062016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.223161:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607062016:12345-0@lo:400:kworker.0 Request processed in 38us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535870.223167:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1788535870.226538:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535870.226549:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535870.226552:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535870.227031:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607062144:0@lo:400:kworker.0 00010000:00080000:2.0:1788535870.227057:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6ac2300 x1875415607062656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535870.227069:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607062656:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.227080:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607062016:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.227092:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607062528:0@lo:400:kworker.0 00010000:00080000:2.0:1788535870.227160:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf2a9180 x1875415607062400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535870.227172:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607062400:0@lo:400:kworker.0 00000100:00100000:3.0:1788535870.228162:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607062272:0@lo:400:kworker.0 00000100:00100000:1.0:1788535870.330719:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535870.330758:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535870.330792:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535870.330807:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589204224 00000100:00100000:0.0:1788535870.330818:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589204224 00000100:00100000:1.0:1788535870.330822:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535870.330846:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535870.330862:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:1.0:1788535870.330866:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589204480 00000100:00100000:1.0:1788535870.330870:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589204480 00000100:00100000:0.0:1788535870.330872:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2356:x1875415589204224:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535870.330951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589204352 00000100:00100000:1.0:1788535870.330967:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589204352 00000100:00100000:0.0:1788535870.330989:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2356:x1875415589204224:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 119us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535870.330993:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1788535870.330998:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:1.0:1788535870.330999:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589204480:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535870.331027:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589204480:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535870.331033:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:1.0:1788535870.331044:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:1.0:1788535870.331049:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589204352:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535870.331068:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589204352:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 19us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535870.331073:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:1.0:1788535870.331089:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589204736 00000100:00100000:1.0:1788535870.331092:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589204736 00000100:00100000:1.0:1788535870.331115:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589204608 00000100:00100000:1.0:1788535870.331118:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589204608 00000100:00100000:1.0:1788535870.331137:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:1.0:1788535870.331143:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589204736:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535870.331168:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589204736:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535870.331174:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:1.0:1788535870.331185:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1788535870.331191:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589204608:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535870.331212:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589204608:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535870.331218:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00080000:1.0:1788535870.331239:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788535870.331243:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535870.331245:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788535870.350538:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535870.733491:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607062784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535870.733552:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.733635:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607062784 00000100:00100000:2.0:1788535870.733643:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607062784 00000100:00100000:2.0:1788535870.733707:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788535870.733718:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607062784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535870.733753:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788535870.734060:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607062784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 343us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.734068:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788535870.734117:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b9308380 x1875415607062784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535870.734136:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607062784:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788535871.373125:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535871.759059:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535871.759085:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b737b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607062912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535871.759746:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535871.760056:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607062912 00000100:00100000:1.0:1788535871.760065:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607062912 00000100:00100000:1.0:1788535871.760223:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788535871.760234:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607062912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535871.760279:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535871.760333:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607062912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535871.760340:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788535871.760606:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b737b480 x1875415607062912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535871.760630:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b737b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607062912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788535872.397135:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535873.421821:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535874.448934:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788535875.306229:0:10979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788535875.343184:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607063296:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.343251:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.343310:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535875.343316:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607063424:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.343339:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535875.343411:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607063168:0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.343439:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535875.343460:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607063680:0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.343478:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535875.343498:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788535875.343503:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607063040:0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.343529:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535875.343550:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607063552:0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.343567:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535875.343593:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607063296 00000100:00100000:1.0:1788535875.343599:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607063296 00000100:00100000:1.0:1788535875.343655:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607063168 00000100:00100000:1.0:1788535875.343658:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607063168 00000100:00100000:1.0:1788535875.343671:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607063552 00000100:00100000:1.0:1788535875.343673:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607063552 00000100:00100000:1.0:1788535875.343688:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788535875.343696:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607063296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.343749:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607063296:12345-0@lo:400:kworker.0 Request processed in 53us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535875.343756:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788535875.343771:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788535875.343776:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607063168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.343810:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607063168:12345-0@lo:400:kworker.0 Request processed in 33us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535875.343815:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788535875.343825:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788535875.343831:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607063552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.343852:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607063552:12345-0@lo:400:kworker.0 Request processed in 22us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535875.343858:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788535875.343873:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607063424 00000100:00100000:1.0:1788535875.343876:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607063424 00000100:00100000:1.0:1788535875.343947:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607063680 00000100:00100000:1.0:1788535875.343951:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607063680 00000100:00100000:1.0:1788535875.343980:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788535875.343988:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607063424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.344019:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607063424:12345-0@lo:400:kworker.0 Request processed in 33us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535875.344025:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788535875.344037:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788535875.344043:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607063680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.344069:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607063680:12345-0@lo:400:kworker.0 Request processed in 26us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535875.344083:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788535875.344106:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607063040 00000100:00100000:1.0:1788535875.344109:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607063040 00000100:00100000:1.0:1788535875.344132:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788535875.344137:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3311:x1875415607063040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.344165:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3311:x1875415607063040:12345-0@lo:400:kworker.0 Request processed in 28us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535875.344170:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:1.0:1788535875.344195:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535875.344198:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788535875.344201:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535875.344229:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607063040:0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.344241:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607063552:0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.344249:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607063168:0@lo:400:kworker.0 00010000:00080000:1.0:1788535875.344258:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b91a6680 x1875415607063680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535875.344268:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607063680:0@lo:400:kworker.0 00010000:00080000:1.0:1788535875.344299:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b91a4000 x1875415607063424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535875.344308:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607063424:0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.344316:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607063296:0@lo:400:kworker.0 00000100:00100000:2.0:1788535875.450333:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535875.450373:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535875.450408:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535875.450421:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589205248 00000100:00100000:3.0:1788535875.450431:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589205248 00000100:00100000:2.0:1788535875.450475:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535875.450487:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589205376 00000100:00100000:3.0:1788535875.450490:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589205376 00000100:00100000:2.0:1788535875.450500:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788535875.450522:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2354:x1875415589205248:12345-192.168.203.12@tcp:9:kworker.0 00000100:00100000:0.0:1788535875.450527:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589204864 00000100:00100000:0.0:1788535875.450531:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589204864 00000020:00000080:2.0:1788535875.450550:0:6671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3a35 00000100:00100000:0.0:1788535875.450556:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00080000:2.0:1788535875.450559:0:6671:0:(import.c:65:import_set_state_nolock()) ffff97a9bfd16800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788535875.450562:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2358:x1875415589204864:12345-192.168.203.12@tcp:400:kworker.0 00000001:00000004:2.0:1788535875.450606:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788535875.450616:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2358:x1875415589204864:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 54us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.450623:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:2.0:1788535875.450964:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+2:2354:x1875415589205248:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 444us (587us total) trans 0 rc 0/0 00010000:00010000:0.0:1788535875.452319:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535875.452341:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589204992 00000100:00100000:0.0:1788535875.452349:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589204992 00000100:00100000:0.0:1788535875.452399:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:0.0:1788535875.452408:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b737aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+6:2357:x1875415589204992:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535875.452468:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b737aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+6:2357:x1875415589204992:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 62us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.452475:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00080000:0.0:1788535875.456956:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788535875.456969:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535875.456971:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788535875.459574:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535875.461307:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:3.0:1788535875.461335:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2354:x1875415589205376:12345-192.168.203.12@tcp:9:kworker.0 00000100:00100000:2.0:1788535875.462326:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788535875.470491:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589205120 00000100:00100000:1.0:1788535875.470521:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589205120 00000100:00100000:1.0:1788535875.470596:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:1.0:1788535875.470607:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589205120:12345-192.168.203.12@tcp:400:kworker.0 00000020:00000080:3.0:1788535875.470624:0:6674:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3a3c 00000100:00100000:1.0:1788535875.470696:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589205120:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 90us (11130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535875.470703:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00080000:1.0:1788535875.470765:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788535875.470798:0:6674:0:(import.c:65:import_set_state_nolock()) ffff97a9bfd15000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788535875.471147:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788535875.471545:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+2:2354:x1875415589205376:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 10221us (21133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535875.471554:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00010000:00010000:3.0:1788535875.471583:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535875.472455:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535875.854470:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607063808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535875.854544:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535875.854996:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607063808 00000100:00100000:3.0:1788535875.855004:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607063808 00000100:00100000:3.0:1788535875.855073:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788535875.855082:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607063808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788535875.855118:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788535875.855174:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607063808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535875.855181:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788535875.855785:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b930b800 x1875415607063808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535875.855805:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607063808:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788535876.493077:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535876.883118:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607063936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535876.883191:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535876.883335:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607063936 00000100:00100000:0.0:1788535876.883343:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607063936 00000100:00100000:0.0:1788535876.883407:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788535876.883417:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607063936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788535876.883450:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535876.886860:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607063936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3435us (3659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535876.886885:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788535876.891757:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b7379180 x1875415607063936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535876.891789:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607063936:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788535877.517385:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788535878.203852:0:11126:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4f777910 20000000:00000080:1.0:1788535878.203881:0:11126:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a9b66a7400 uarg=0000000000000000 20000000:01000000:1.0:1788535878.204190:0:11126:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788535878.204197:0:11126:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788535878.204202:0:11126:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788535878.205172:0:11127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788535878.205423:0:11126:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788535878.213657:0:11126:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788535878.213699:0:11126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535878.213720:0:11126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981653200/0x74f51638375d39e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515595 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535878.213729:0:11126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981653400/0x74f51638375d39f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d39ef expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535878.213753:0:11126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981653600/0x74f51638375d3a04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d39fd expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535878.213759:0:11126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981652c00/0x74f51638375d3a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3a0b expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535878.213766:0:11126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9c2050e00/0x74f51638375d3a27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155cd expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535878.213774:0:11126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535878.213817:0:11126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9c2050e00/0x74f51638375d3a27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155cd expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535878.213832:0:11126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a9c2050e00/0x74f51638375d3a27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155cd expref: 12 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535878.213848:0:11126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875415607064064:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535878.214100:0:11126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981652c00/0x74f51638375d3a12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d3a0b expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535878.214109:0:11126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a981652c00/0x74f51638375d3a12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d3a0b expref: 18 pid: 5827 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535878.214118:0:11126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875415607064192:0@lo:104: 00000100:00100000:1.0:1788535878.214156:0:11126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788535878.214186:0:11126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981653600/0x74f51638375d3a04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d39fd expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535878.214204:0:11126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a981653600/0x74f51638375d3a04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d39fd expref: 18 pid: 5825 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535878.214213:0:11126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875415607064320:0@lo:104: 00000100:00100000:2.0:1788535878.214506:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607064192 00000100:00100000:2.0:1788535878.214514:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607064192 00000100:00100000:2.0:1788535878.214557:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788535878.214565:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:11126:x1875415607064192:12345-0@lo:104: 00010000:00010000:2.0:1788535878.214648:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3a12 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535878.214748:0:11126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788535878.214772:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788535878.214780:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:11126:x1875415607064192:12345-0@lo:104: Request processed in 215us (624us total) trans 0 rc 0/0 00010000:00010000:1.0:1788535878.214783:0:11126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981653400/0x74f51638375d39f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d39ef expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535878.214792:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1788535878.214800:0:11126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a981653400/0x74f51638375d39f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d39ef expref: 18 pid: 5825 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535878.214811:0:11126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875415607064448:0@lo:104: 00000100:00100000:2.0:1788535878.214813:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607064320 00000100:00100000:2.0:1788535878.214817:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607064320 00000100:00100000:2.0:1788535878.214836:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788535878.214843:0:11126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535878.214845:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:11126:x1875415607064320:12345-0@lo:104: 00010000:00010000:2.0:1788535878.214855:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3a04 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535878.214881:0:11126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981653200/0x74f51638375d39e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515595 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.214938:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788535878.214952:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:11126:x1875415607064320:12345-0@lo:104: Request processed in 109us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535878.214958:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788535878.214972:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607064448 00000100:00100000:2.0:1788535878.214975:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607064448 00000100:00100000:2.0:1788535878.214990:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788535878.214997:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:11126:x1875415607064448:12345-0@lo:104: 00010000:00010000:2.0:1788535878.215005:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d39f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215043:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788535878.215050:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:11126:x1875415607064448:12345-0@lo:104: Request processed in 52us (207us total) trans 0 rc 0/0 00010000:00010000:1.0:1788535878.215058:0:11126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a981653200/0x74f51638375d39e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515595 expref: 12 pid: 5827 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535878.215059:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788535878.215075:0:11126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d07100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875415607064576:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535878.215082:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788535878.215090:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3a12 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215099:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980031e00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:2.0:1788535878.215103:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d3a12 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215112:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d3a12 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535878.215119:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d3a12 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535878.215125:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788535878.215155:0:11126:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b6c14780 going to sleep for 11 seconds 00000100:00100000:1.0:1788535878.215180:0:11126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875415607064192:0@lo:104: 00000100:00100000:1.0:1788535878.215188:0:11126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875415607064320:0@lo:104: 00000100:00100000:1.0:1788535878.215195:0:11126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875415607064448:0@lo:104: 00010000:00010000:2.0:1788535878.215557:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a12 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215641:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535878.215664:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a12 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215671:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a980031e00/0x74f51638375d3a0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a12 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215685:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788535878.215751:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3a04 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215758:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980031000 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:2.0:1788535878.215761:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d3a04 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215768:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d3a04 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535878.215775:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d3a04 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535878.215782:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788535878.215796:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a04 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215803:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535878.215810:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a04 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215816:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a980031000/0x74f51638375d39fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a04 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215832:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535878.215835:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d39f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215841:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981653000 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:2.0:1788535878.215845:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d39f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215852:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d39f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535878.215853:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1788535878.215870:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d39f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535878.215876:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788535878.215907:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d39f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215912:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535878.215928:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d39f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215935:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d39ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d39f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.215950:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535878.215952:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535878.215954:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535878.215961:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535878.215962:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607064704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788535878.215981:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607064832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788535878.216019:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535878.216029:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535878.216073:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b737a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607064960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788535878.216079:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607064704 00000100:00100000:0.0:1788535878.216086:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607064704 00000100:00100000:2.0:1788535878.216097:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788535878.216111:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981652c00/0x74f51638375d3a12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3a0b expref: 19 pid: 5827 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535878.216137:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607064832 00000100:00100000:0.0:1788535878.216140:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607064832 00010000:00010000:0.0:1788535878.216154:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981653600/0x74f51638375d3a04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d39fd expref: 20 pid: 5825 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535878.216191:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607064960 00000100:00100000:2.0:1788535878.216197:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607064960 00010000:00010000:2.0:1788535878.216213:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981653400/0x74f51638375d39f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d39ef expref: 21 pid: 5825 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535878.216230:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788535878.216476:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+21:3310:x1875415607064704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535878.216488:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535878.216493:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981652c00/0x74f51638375d3a12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3a0b expref: 21 pid: 5827 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.216504:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981652c00/0x74f51638375d3a12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d3a0b expref: 21 pid: 5827 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.216519:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981652c00/0x74f51638375d3a12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d3a0b expref: 21 pid: 5827 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.216533:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535878.216565:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+20:3310:x1875415607064704:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535878.216823:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788535878.216875:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788535878.216882:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b737b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3311:x1875415607064832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535878.216913:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535878.216925:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981653600/0x74f51638375d3a04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d39fd expref: 19 pid: 5825 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.216934:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981653600/0x74f51638375d3a04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d39fd expref: 19 pid: 5825 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.216945:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981653600/0x74f51638375d3a04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d39fd expref: 19 pid: 5825 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.216953:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535878.216987:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b737b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:3311:x1875415607064832:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535878.216993:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788535878.217011:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788535878.217018:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7378000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:3308:x1875415607064960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535878.217026:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535878.217029:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981653400/0x74f51638375d39f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d39ef expref: 17 pid: 5825 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.217038:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981653400/0x74f51638375d39f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d39ef expref: 17 pid: 5825 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.217047:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981653400/0x74f51638375d39f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d39ef expref: 17 pid: 5825 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.217055:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535878.217080:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7378000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:3308:x1875415607064960:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535878.217086:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788535878.217127:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b737a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607064960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788535878.217221:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607064832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788535878.217783:0:11126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875415607064064:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535878.218795:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607064704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535878.219087:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535878.219146:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589205504 00000100:00100000:2.0:1788535878.219153:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589205504 00010000:00010000:2.0:1788535878.219186:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9c2050e00/0x74f51638375d3a27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155cd expref: 13 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535878.219222:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1788535878.219231:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2355:x1875415589205504:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535878.219252:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535878.219257:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9c2050e00/0x74f51638375d3a27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155cd expref: 13 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.219268:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9c2050e00/0x74f51638375d3a27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155cd expref: 13 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.219283:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9c2050e00/0x74f51638375d3a27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155cd expref: 13 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.219298:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535878.219351:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:2355:x1875415589205504:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 121us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535878.219358:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1788535878.223217:0:11126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d07100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875415607064576:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535878.223279:0:11126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535878.224771:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535878.224992:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589205632 00000100:00100000:2.0:1788535878.225001:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589205632 00010000:00010000:2.0:1788535878.225050:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981653200/0x74f51638375d39e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515595 expref: 12 pid: 5827 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535878.225083:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1788535878.225094:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:2356:x1875415589205632:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535878.225109:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535878.225115:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981653200/0x74f51638375d39e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515595 expref: 12 pid: 5827 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.225129:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981653200/0x74f51638375d39e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515595 expref: 12 pid: 5827 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.225154:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981653200/0x74f51638375d39e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515595 expref: 12 pid: 5827 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.225175:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.225183:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.225200:0:7598:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.225207:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.225225:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.225232:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.225392:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981652600 already unused, calling callback (ffffffffc1455530) 00010000:00010000:2.0:1788535878.225396:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.225405:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.225421:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535878.225432:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535878.225484:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:2356:x1875415589205632:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 392us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535878.225492:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00010000:00010000:1.0:1788535878.226620:0:11126:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535878.226647:0:11126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535878.226654:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981652600/0x74f51638375d3a43 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1788535878.460242:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 71ebecc8-0d84-4b23-8d21-de56113948a9 00000020:00000080:2.0:1788535878.460251:0:6701:0:(genops.c:885:class_export_put()) final put ffff97a9bfd10800/71ebecc8-0d84-4b23-8d21-de56113948a9 00000020:00000080:0.0:1788535878.460379:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bfd10800/71ebecc8-0d84-4b23-8d21-de56113948a9 for lustre-OST0000 00000020:00000080:0.0:1788535878.460432:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9bfd16800 for lustre-OST0000 00010000:00010000:3.0:1788535878.542219:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535879.565102:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535879.602817:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535879.602971:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589205760 00000100:00100000:1.0:1788535879.602981:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589205760 00000100:00100000:1.0:1788535879.603032:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:1.0:1788535879.603042:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:5595:x1875415589205760:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535879.603059:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535879.603077:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981653c00/0x74f51638375d3a4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f975155f7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535879.603102:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981653c00/0x74f51638375d3a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155f7 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535879.603113:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981653c00/0x74f51638375d3a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155f7 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535879.603133:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981653c00, rc 0) 00000100:00100000:1.0:1788535879.603195:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:5595:x1875415589205760:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 154us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535879.603205:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:3.0:1788535879.605774:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535879.605985:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589205888 00000100:00100000:2.0:1788535879.605994:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589205888 00000100:00100000:2.0:1788535879.606047:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:2.0:1788535879.606057:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:5595:x1875415589205888:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535879.606590:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:5595:x1875415589205888:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 532us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535879.606609:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:3.0:1788535879.608944:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535879.609006:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589206016 00000100:00100000:1.0:1788535879.609016:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589206016 00000100:00100000:1.0:1788535879.609064:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:1.0:1788535879.609073:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:5595:x1875415589206016:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535879.609633:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:5595:x1875415589206016:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 558us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535879.609642:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:3.0:1788535879.613686:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535879.613985:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589206144 00000100:00100000:1.0:1788535879.613995:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589206144 00000100:00100000:1.0:1788535879.614085:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:1.0:1788535879.614096:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:5595:x1875415589206144:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535879.614112:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535879.614130:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981653e00/0x74f51638375d3a51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f975155fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535879.614156:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981653e00/0x74f51638375d3a51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155fe expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535879.614168:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981653e00/0x74f51638375d3a51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155fe expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535879.614188:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981653e00, rc 0) 00000100:00100000:1.0:1788535879.614246:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:5595:x1875415589206144:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 152us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535879.614253:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:2.0:1788535879.616623:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535879.617042:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589206272 00000100:00100000:1.0:1788535879.617053:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589206272 00000100:00100000:1.0:1788535879.617109:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:1.0:1788535879.617118:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:5595:x1875415589206272:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535879.617426:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:5595:x1875415589206272:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 306us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535879.617441:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:3.0:1788535879.620251:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535879.620932:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589206400 00000100:00100000:1.0:1788535879.620945:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589206400 00000100:00100000:1.0:1788535879.621014:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:1.0:1788535879.621026:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:5595:x1875415589206400:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535879.621246:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:5595:x1875415589206400:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 222us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535879.621256:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 227 10000000:01000000:1.0:1788535880.079927:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788535880.079936:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a986ffc800 from 7 10000000:01000000:1.0:1788535880.079942:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788535880.079995:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535880.080008:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535880.080019:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535880.080055:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788535880.080129:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535880.080188:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b9306d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535880.080269:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607065088 00000100:00100000:2.0:1788535880.080277:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607065088 00000100:00100000:2.0:1788535880.080328:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788535880.080336:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607065088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535880.080349:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535880.080361:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b747e600/0x74f51638375d3a5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3a58 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535880.080384:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b747e600/0x74f51638375d3a5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3a58 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535880.080394:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b747e600/0x74f51638375d3a5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3a58 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535880.080403:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747e600, rc 0) 00000100:00100000:2.0:1788535880.080444:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607065088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.080450:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788535880.080569:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535880.080585:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535880.080610:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3a5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535880.080663:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535880.080690:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535880.080717:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99cbd09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535880.080773:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607065216 00000100:00100000:2.0:1788535880.080778:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607065216 00000100:00100000:2.0:1788535880.080810:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788535880.080817:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607065216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535880.081073:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607065216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.081081:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788535880.081169:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535880.081202:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535880.081238:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535880.081266:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99cbd09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535880.081316:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607065344 00000100:00100000:2.0:1788535880.081321:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607065344 00000100:00100000:2.0:1788535880.081349:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788535880.081355:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607065344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535880.081497:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607065344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.081504:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788535880.081585:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788535880.087738:0:11226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788535880.095525:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788535880.095559:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788535880.095570:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535880.095584:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535880.095596:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788535880.095598:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a9a7dac800 from 7 10000000:01000000:2.0:1788535880.095601:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788535880.095642:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535880.095650:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535880.095660:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535880.095683:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7379c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788535880.095746:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.095799:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b6c169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535880.096000:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607065472 00000100:00100000:1.0:1788535880.096008:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607065472 00000100:00100000:1.0:1788535880.096061:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788535880.096072:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607065472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535880.096094:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535880.096107:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a981652c00/0x74f51638375d3a6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3a66 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535880.096131:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a981652c00/0x74f51638375d3a6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3a66 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535880.096143:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a981652c00/0x74f51638375d3a6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3a66 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535880.096151:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981652c00, rc 0) 00000100:00100000:1.0:1788535880.096204:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607065472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535880.096210:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788535880.096253:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7379c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535880.096266:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535880.096275:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3a6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535880.096326:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535880.096349:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535880.096368:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b9306600 going to sleep for 11 seconds 00000100:00100000:1.0:1788535880.096379:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607065600 00000100:00100000:1.0:1788535880.096382:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607065600 00000100:00100000:1.0:1788535880.096401:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788535880.096407:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607065600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535880.096658:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607065600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535880.096665:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788535880.096694:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535880.096722:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535880.096757:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535880.096770:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b9306600 going to sleep for 11 seconds 00000100:00100000:1.0:1788535880.096781:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607065728 00000100:00100000:1.0:1788535880.096784:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607065728 00000100:00100000:1.0:1788535880.096806:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788535880.096811:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607065728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535880.100176:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607065728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3354us (3408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535880.100191:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788535880.100654:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788535880.108227:0:11227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788535880.108405:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788535880.108426:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788535880.108437:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535880.108448:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535880.108459:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788535880.108461:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a9ac46a000 from 7 10000000:01000000:1.0:1788535880.108464:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788535880.108511:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535880.108531:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535880.108544:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535880.108573:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788535880.108640:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535880.108682:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b9306180 going to sleep for 11 seconds 00000100:00100000:0.0:1788535880.113978:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607065856 00000100:00100000:0.0:1788535880.113993:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607065856 00000100:00100000:0.0:1788535880.114058:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788535880.114069:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607065856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535880.114086:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535880.114103:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9c2050600/0x74f51638375d3a7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3a74 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535880.114133:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9c2050600/0x74f51638375d3a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3a74 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535880.114144:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9c2050600/0x74f51638375d3a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3a74 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535880.114168:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c2050600, rc 0) 00000100:00100000:0.0:1788535880.114238:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607065856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (5598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535880.114245:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788535880.114294:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535880.114312:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535880.114322:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3a7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535880.114391:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535880.114418:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535880.114455:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9856f1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788535880.114468:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607065984 00000100:00100000:0.0:1788535880.114471:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607065984 00000100:00100000:0.0:1788535880.114489:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788535880.114495:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607065984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535880.114709:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607065984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535880.114716:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788535880.114742:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607065984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535880.114764:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607066112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535880.114795:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535880.114811:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987b51180 going to sleep for 11 seconds 00000100:00100000:0.0:1788535880.114820:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607066112 00000100:00100000:0.0:1788535880.114823:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607066112 00000100:00100000:0.0:1788535880.114839:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788535880.114843:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607066112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535880.114997:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607066112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535880.115003:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788535880.115032:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607066112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788535880.119528:0:11228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788535880.119810:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788535880.119831:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788535880.119841:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535880.119865:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3a7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535880.462142:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607066624:0@lo:400:kworker.0 00000100:00100000:1.0:1788535880.462206:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535880.462257:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788535880.462263:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607066240:0@lo:400:kworker.0 00000100:00100000:1.0:1788535880.462286:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535880.462300:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607066752:0@lo:400:kworker.0 00000100:00100000:1.0:1788535880.462320:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535880.462349:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607066496:0@lo:400:kworker.0 00000100:00100000:1.0:1788535880.462369:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535880.462384:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535880.462389:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607066368:0@lo:400:kworker.0 00000100:00100000:1.0:1788535880.462407:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535880.462431:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607066752 00000100:00100000:1.0:1788535880.462437:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607066752 00000100:00100000:1.0:1788535880.462483:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607066496 00000100:00100000:1.0:1788535880.462486:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607066496 00000100:00100000:1.0:1788535880.462516:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788535880.462523:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607066752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535880.462569:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607066752:12345-0@lo:400:kworker.0 Request processed in 46us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535880.462575:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788535880.462589:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788535880.462594:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607066496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535880.462618:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607066496:12345-0@lo:400:kworker.0 Request processed in 25us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535880.462637:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788535880.462656:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607066624 00000100:00100000:1.0:1788535880.462659:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607066624 00000100:00100000:1.0:1788535880.462678:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607066240 00000100:00100000:1.0:1788535880.462680:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607066240 00000100:00100000:1.0:1788535880.462688:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607066368 00000100:00100000:1.0:1788535880.462691:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607066368 00000100:00100000:1.0:1788535880.462702:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788535880.462707:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607066624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535880.462732:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607066624:12345-0@lo:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535880.462738:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788535880.462748:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788535880.462752:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607066240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535880.462772:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607066240:12345-0@lo:400:kworker.0 Request processed in 20us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535880.462777:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788535880.462785:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788535880.462795:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607066368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535880.462818:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607066368:12345-0@lo:400:kworker.0 Request processed in 24us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535880.462823:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788535880.462836:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788535880.462840:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788535880.462842:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788535880.462907:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607066368:0@lo:400:kworker.0 00010000:00080000:1.0:1788535880.462920:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d05880 x1875415607066496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535880.462929:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607066496:0@lo:400:kworker.0 00000100:00100000:1.0:1788535880.462954:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607066240:0@lo:400:kworker.0 00010000:00080000:1.0:1788535880.462962:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf15c700 x1875415607066752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535880.462969:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607066752:0@lo:400:kworker.0 00000100:00100000:1.0:1788535880.462976:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607066624:0@lo:400:kworker.0 00000001:00100000:3.0:1788535880.553287:0:7609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 71ebecc8-0d84-4b23-8d21-de56113948a9 00000020:00000080:3.0:1788535880.553296:0:7609:0:(genops.c:885:class_export_put()) final put ffff97a9bfd13800/71ebecc8-0d84-4b23-8d21-de56113948a9 00000020:00000080:3.0:1788535880.553327:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bfd13800/71ebecc8-0d84-4b23-8d21-de56113948a9 for lustre-OST0001 00000020:00000080:3.0:1788535880.553374:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9bfd15000 for lustre-OST0001 00000100:00100000:0.0:1788535880.567735:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535880.567784:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535880.567829:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535880.567874:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589206528 00000100:00100000:0.0:1788535880.567885:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589206528 00000100:00100000:0.0:1788535880.567965:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:0.0:1788535880.567981:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2358:x1875415589206528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535880.568054:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2358:x1875415589206528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 81us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535880.568063:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:1.0:1788535880.569452:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589206656 00000100:00100000:1.0:1788535880.569462:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589206656 00000100:00100000:1.0:1788535880.569510:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589206784 00000100:00100000:1.0:1788535880.569513:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589206784 00000100:00100000:1.0:1788535880.569533:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1788535880.569540:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2358:x1875415589206656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535880.569596:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2358:x1875415589206656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 56us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535880.569613:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1788535880.569629:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1788535880.569636:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589206784:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535880.569663:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589206784:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535880.569669:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00080000:0.0:1788535880.569988:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788535880.591527:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535880.976675:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535880.976698:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607066880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535880.976765:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535880.976835:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607066880 00000100:00100000:3.0:1788535880.976855:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607066880 00000100:00100000:3.0:1788535880.976920:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788535880.976930:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607066880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788535880.976967:0:10342:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788535880.977010:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607066880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535880.977025:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788535880.977066:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6ac2a00 x1875415607066880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535880.977085:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607066880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788535881.613345:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788535881.647215:0:11325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788535881.997320:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788535881.997450:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b737a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607067008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535881.997516:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535881.997828:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607067008 00000100:00100000:0.0:1788535881.997844:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607067008 00000100:00100000:0.0:1788535881.997995:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788535881.998005:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607067008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788535881.998039:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535881.998091:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607067008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535881.998098:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788535881.998172:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b737a300 x1875415607067008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535881.998192:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b737a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607067008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788535882.637139:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535883.662173:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535884.685961:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535885.586466:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf15ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607067136:0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.586545:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535885.586590:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607067648:0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.586616:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535885.586644:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788535885.586651:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607067264:0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.586675:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535885.586693:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf15fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607067776:0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.586717:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535885.586745:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607067392:0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.586779:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535885.586798:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788535885.586803:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607067520:0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.586838:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535885.587165:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607067136 00000100:00100000:1.0:1788535885.587173:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607067136 00000100:00100000:1.0:1788535885.587219:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788535885.587229:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607067136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.587343:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607067136:12345-0@lo:400:kworker.0 Request processed in 115us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535885.587350:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788535885.587382:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607067648 00000100:00100000:1.0:1788535885.587386:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607067648 00000100:00100000:1.0:1788535885.587416:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607067264 00000100:00100000:1.0:1788535885.587418:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607067264 00000100:00100000:1.0:1788535885.587428:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607067392 00000100:00100000:1.0:1788535885.587430:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607067392 00000100:00100000:1.0:1788535885.587444:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788535885.587450:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607067648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.587480:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607067648:12345-0@lo:400:kworker.0 Request processed in 30us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535885.587486:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788535885.587497:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788535885.587503:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607067264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.587528:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607067264:12345-0@lo:400:kworker.0 Request processed in 25us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535885.587534:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788535885.587553:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788535885.587559:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607067392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.587592:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607067392:12345-0@lo:400:kworker.0 Request processed in 33us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535885.587598:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788535885.587620:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607067776 00000100:00100000:1.0:1788535885.587624:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607067776 00000100:00100000:1.0:1788535885.587648:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607067520 00000100:00100000:1.0:1788535885.587651:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607067520 00000100:00100000:1.0:1788535885.587667:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788535885.587673:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607067776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.587700:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607067776:12345-0@lo:400:kworker.0 Request processed in 28us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535885.587706:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788535885.587716:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788535885.587721:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607067520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.587747:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607067520:12345-0@lo:400:kworker.0 Request processed in 26us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535885.587753:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788535885.587792:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788535885.587797:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535885.587799:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788535885.587857:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf15ca80 x1875415607067520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535885.587873:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607067520:0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.587884:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607067392:0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.588126:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607067264:0@lo:400:kworker.0 00010000:00080000:1.0:1788535885.588136:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf15fb80 x1875415607067776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535885.588144:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf15fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607067776:0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.588152:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf15ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607067136:0@lo:400:kworker.0 00000100:00100000:1.0:1788535885.588161:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607067648:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.709005:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535885.709048:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535885.709076:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535885.709108:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589206912 00000100:00100000:0.0:1788535885.709117:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589206912 00000100:00100000:0.0:1788535885.709161:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:0.0:1788535885.709171:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2356:x1875415589206912:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535885.709249:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2356:x1875415589206912:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535885.709257:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:2.0:1788535885.709359:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589207040 00000100:00100000:2.0:1788535885.709364:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589207040 00000100:00100000:2.0:1788535885.709408:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589207168 00000100:00100000:2.0:1788535885.709411:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589207168 00000100:00100000:2.0:1788535885.709430:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:2.0:1788535885.709437:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589207040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535885.709469:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589207040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535885.709475:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:2.0:1788535885.709489:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:2.0:1788535885.709495:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589207168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535885.709519:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589207168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535885.709525:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00010000:00010000:2.0:1788535885.709994:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788535885.710142:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788535886.051752:0:11424:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 11:31:24 (1788535884) === 00000100:00100000:2.0:1788535886.108242:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607067904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535886.108326:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535886.108499:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607067904 00000100:00100000:1.0:1788535886.108508:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607067904 00000100:00100000:1.0:1788535886.108562:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788535886.108571:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607067904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535886.108606:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535886.108649:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607067904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535886.108655:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788535886.108877:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf15ed80 x1875415607067904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535886.108934:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607067904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535886.500240:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535886.500439:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589207296 00000100:00100000:2.0:1788535886.500449:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589207296 00000100:00100000:2.0:1788535886.500521:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788535886.500532:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589207296:12345-192.168.203.12@tcp:41:mkdir.0 00000004:00000024:2.0:1788535886.500576:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788535886.501511:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589207296:12345-192.168.203.12@tcp:41:mkdir.0 Request processed in 975us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535886.501521:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788535886.503113:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535886.503286:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589207424 00000100:00100000:3.0:1788535886.503362:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589207424 00000100:00100000:3.0:1788535886.503488:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788535886.503502:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b737a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:30a1922d-0d3f-4681-a966-cec3672631c6+6:9678:x1875415589207424:12345-192.168.203.12@tcp:700:mkdir.0 00000100:00100000:3.0:1788535886.503661:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b737a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:30a1922d-0d3f-4681-a966-cec3672631c6+6:9678:x1875415589207424:12345-192.168.203.12@tcp:700:mkdir.0 Request processed in 163us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535886.503669:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788535886.510958:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535886.511057:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589207680 00000100:00100000:1.0:1788535886.511068:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589207680 00000100:00100000:1.0:1788535886.511132:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788535886.511142:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:9678:x1875415589207680:12345-192.168.203.12@tcp:36:mkdir.0 00010000:00010000:1.0:1788535886.511195:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535886.511260:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d3963 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515580 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.511283:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a99742aa00) 00010000:00010000:1.0:1788535886.511294:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535886.511597:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3a82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.511610:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3a82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.511621:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3a82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.512316:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a89 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.512330:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.512339:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535886.513585:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788535886.513599:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3a82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.513608:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3a82 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.513615:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3a82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.513682:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981653200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535886.513687:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3a82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.513695:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3a82 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.513715:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888add00) 00010000:00010000:1.0:1788535886.513718:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535886.513722:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3a82 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.513729:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3a82 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788535886.513748:0:6697:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000135eaec2 reply state 00000000ccce9a9d transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535886.513756:0:6697:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535886.514017:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+7:9678:x1875415589207680:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 2873us (3064us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788535886.514026:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00010000:00010000:3.0:1788535886.518650:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.518669:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a89 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.518676:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a89 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.518682:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981653400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535886.518687:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a89 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.518704:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a89 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.518728:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97a9888ada00) 00010000:00010000:3.0:1788535886.518731:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535886.518736:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a89 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.518742:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a89 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535886.534845:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535886.535051:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589207808 00000100:00100000:1.0:1788535886.535062:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589207808 00000100:00100000:1.0:1788535886.535115:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788535886.535136:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:9679:x1875415589207808:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:1.0:1788535886.535158:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535886.535180:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3a90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515605 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.535242:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.535256:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.535284:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535886.535319:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788535886.535322:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535886.535357:0:5832:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.535382:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3a90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515605 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.535400:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515605 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.535409:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888add00) 00010000:00010000:1.0:1788535886.535411:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535886.535415:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a981653400, rc 0) 00000100:00100000:1.0:1788535886.535478:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+7:9679:x1875415589207808:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 353us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535886.535485:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788535886.541207:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535886.541279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589208064 00000100:00100000:2.0:1788535886.541289:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589208064 00000100:00100000:2.0:1788535886.541344:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788535886.541353:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:9679:x1875415589208064:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:2.0:1788535886.541452:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535886.541477:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3a97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515605 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.541499:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888add00) 00010000:00010000:2.0:1788535886.541509:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535886.541533:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3a9e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.541546:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3a9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.541556:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3a9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535886.541866:0:5833:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000014e150d reply state 000000007c054de3 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3a9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535886.541905:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788535886.541914:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788535886.541987:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:9679:x1875415589208064:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 634us (790us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788535886.541993:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00010000:00010000:3.0:1788535886.544363:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3a9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.544380:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3a9e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.544389:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3a9e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.544395:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535886.544399:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3a9e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.544418:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3a9e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.544433:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a99742ac00) 00010000:00010000:3.0:1788535886.544436:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788535886.544441:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3a9e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.544460:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3a9e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535886.569797:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535886.569870:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589208192 00000100:00100000:2.0:1788535886.569881:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589208192 00000100:00100000:2.0:1788535886.569964:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788535886.569977:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+7:9680:x1875415589208192:12345-192.168.203.12@tcp:101:chown.0 00010000:00010000:2.0:1788535886.570001:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535886.570024:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fa00/0x74f51638375d3aa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751560c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.570086:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3aac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.570099:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3aac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.570111:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3aac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535886.570145:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788535886.570148:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788535886.570188:0:5834:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3aac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.570214:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fa00/0x74f51638375d3aa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751560c expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.570252:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3aac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751560c expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.570262:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a99742a800) 00010000:00010000:2.0:1788535886.570265:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788535886.570268:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747ee00, rc 0) 00000100:00100000:2.0:1788535886.570326:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+8:9680:x1875415589208192:12345-192.168.203.12@tcp:101:chown.0 Request processed in 352us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535886.570335:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788535886.572997:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535886.573174:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589208320 00000100:00100000:1.0:1788535886.573183:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589208320 00000100:00100000:1.0:1788535886.573235:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788535886.573246:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+8:9680:x1875415589208320:12345-192.168.203.12@tcp:101:chown.0 00010000:00010000:1.0:1788535886.573265:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535886.573306:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3ab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515613 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573370:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a981652600/0x74f51638375d3aba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573384:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a981652600/0x74f51638375d3aba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573398:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a981652600/0x74f51638375d3aba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573412:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3ac1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573419:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573425:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573515:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3ac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573523:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573530:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535886.573555:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788535886.573559:0:6697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535886.573576:0:6697:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573593:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a981652600/0x74f51638375d3aba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573599:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a981652600/0x74f51638375d3aba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573606:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a981652600/0x74f51638375d3aba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573612:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981652600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535886.573616:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a981652600/0x74f51638375d3aba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573623:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a981652600/0x74f51638375d3aba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573633:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a99742a800) 00010000:00010000:1.0:1788535886.573636:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535886.573640:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a981652600/0x74f51638375d3aba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573646:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a981652600/0x74f51638375d3aba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573658:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573664:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573671:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573679:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981653400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535886.573683:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573689:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573697:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97a9888ad100) 00010000:00010000:1.0:1788535886.573699:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535886.573701:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3ac1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573706:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653400/0x74f51638375d3ac1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573734:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a981653200/0x74f51638375d3ab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515613 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573747:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515613 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.573754:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a9888ad900) 00010000:00010000:1.0:1788535886.573756:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535886.573758:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0aa00, rc 0) 00000100:00100000:1.0:1788535886.573826:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+9:9680:x1875415589208320:12345-192.168.203.12@tcp:101:chown.0 Request processed in 582us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535886.573834:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1788535886.576576:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535886.576712:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589208576 00000100:00100000:1.0:1788535886.576731:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589208576 00000100:00100000:1.0:1788535886.576777:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788535886.576785:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+9:9680:x1875415589208576:12345-192.168.203.12@tcp:36:chown.0 00010000:00010000:1.0:1788535886.576841:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535886.576869:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3ac8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515613 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.576965:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a9888ad900) 00010000:00010000:1.0:1788535886.576977:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535886.576997:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3acf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.577009:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3acf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.577018:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3acf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535886.600823:0:5832:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000c9f0c079 reply state 00000000c052c553 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3acf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535886.600840:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788535886.600854:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788535886.600983:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+10:9680:x1875415589208576:12345-192.168.203.12@tcp:36:chown.0 Request processed in 24194us (24411us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788535886.600992:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000001:00080000:0.0:1788535886.603184:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1788535886.603531:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3acf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.603545:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3acf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.603554:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3acf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.603561:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535886.603579:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3acf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.603588:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3acf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.603604:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a9888ad000) 00010000:00010000:2.0:1788535886.603608:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788535886.603613:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3acf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.603619:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3acf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535886.616877:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535886.617266:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589208704 00000100:00100000:2.0:1788535886.617285:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589208704 00000100:00100000:2.0:1788535886.617352:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1788535886.617364:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+6:9681:x1875415589208704:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:2.0:1788535886.617388:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535886.617409:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3ad6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751561a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788535886.618460:0:5833:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1002us 00010000:00010000:1.0:1788535886.654838:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3add lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.654862:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3add lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.654874:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3add lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.654918:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3ae4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.654946:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.654953:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655269:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3aeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655279:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655287:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535886.655307:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788535886.655311:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535886.655537:0:5833:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655551:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3add lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655558:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3add lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655563:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3add lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655568:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535886.655572:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3add lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655586:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3add lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655597:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a99742a800) 00010000:00010000:1.0:1788535886.655600:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535886.655604:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3add lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655610:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3add lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655620:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655625:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655630:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655634:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535886.655637:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655642:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655648:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97a9888ad100) 00010000:00010000:1.0:1788535886.655650:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535886.655653:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3ae4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655669:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3ae4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655707:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3ad6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751561a expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655723:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3aeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751561a expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.655732:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a9888ad900) 00010000:00010000:1.0:1788535886.655734:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788535886.655737:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a000, rc 0) 00000100:00100000:1.0:1788535886.655821:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:9681:x1875415589208704:12345-192.168.203.12@tcp:101:touch.500 Request processed in 38459us (38953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535886.655830:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788535886.662106:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535886.662233:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589208960 00000100:00100000:1.0:1788535886.662245:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589208960 00000100:00100000:1.0:1788535886.662300:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1788535886.662311:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+7:9681:x1875415589208960:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:1.0:1788535886.662341:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535886.662360:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3af2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515621 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.662600:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3af9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.662615:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3af9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.662635:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3af9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.662700:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a600/0x74f51638375d3b00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.662709:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a600/0x74f51638375d3b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.662716:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a600/0x74f51638375d3b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788535886.665977:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788535886.666277:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050e00/0x74f51638375d3b07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.666303:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050e00/0x74f51638375d3b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.666315:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050e00/0x74f51638375d3b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.666352:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3af9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.666359:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3af9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.666366:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3af9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.666371:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ae00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535886.666376:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3af9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.666382:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3af9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.666394:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a9888ad900) 00010000:00010000:0.0:1788535886.666397:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535886.666401:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3af9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.666408:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3af9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535886.666419:0:5834:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000001ddf36b9 reply state 000000002230f58a transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a600/0x74f51638375d3b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535886.666437:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788535886.666472:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3af2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515621 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.666486:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050e00/0x74f51638375d3b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515621 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.666494:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a9a0685600) 00010000:00010000:0.0:1788535886.666496:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535886.666499:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c2050e00, rc 0) 00000100:00100000:0.0:1788535886.666636:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+10:9681:x1875415589208960:12345-192.168.203.12@tcp:101:touch.500 Request processed in 4326us (4539us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788535886.666643:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00010000:00010000:3.0:1788535886.669422:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a600/0x74f51638375d3b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.669440:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a600/0x74f51638375d3b00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.669447:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a600/0x74f51638375d3b00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.669455:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535886.669460:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a600/0x74f51638375d3b00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.669467:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a600/0x74f51638375d3b00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.669480:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff97a9888adc00) 00010000:00010000:3.0:1788535886.669483:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535886.669487:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a600/0x74f51638375d3b00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.669493:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a600/0x74f51638375d3b00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535886.675051:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535886.675139:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589209216 00000100:00100000:1.0:1788535886.675150:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589209216 00000100:00100000:1.0:1788535886.675208:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1788535886.675218:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+9:9681:x1875415589209216:12345-192.168.203.12@tcp:36:touch.500 00010000:00010000:1.0:1788535886.675280:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535886.675308:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050e00/0x74f51638375d3b07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515621 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.675329:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a9a0685600) 00010000:00010000:1.0:1788535886.675340:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535886.675385:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3b15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.675398:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.675408:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788535886.675569:0:6697:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000e5c26082 reply state 000000001e726b24 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535886.675579:0:6697:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535886.675666:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+10:9681:x1875415589209216:12345-192.168.203.12@tcp:36:touch.500 Request processed in 449us (624us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788535886.675673:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1788535886.686096:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535886.686343:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589209344 00000100:00100000:0.0:1788535886.686354:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589209344 00000100:00100000:0.0:1788535886.686415:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1788535886.686426:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+10:9681:x1875415589209344:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:0.0:1788535886.686449:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535886.686471:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050000/0x74f51638375d3b1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515628 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.686531:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050000/0x74f51638375d3b1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515628 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.686545:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050000/0x74f51638375d3b1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515628 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.686581:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a9888ad100) 00010000:00010000:0.0:1788535886.686585:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788535886.686588:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c2050000, rc 0) 00000100:00100000:0.0:1788535886.686644:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+11:9681:x1875415589209344:12345-192.168.203.12@tcp:101:touch.500 Request processed in 220us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535886.686650:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00010000:00010000:3.0:1788535886.687001:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.687011:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3b15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.687024:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3b15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.687030:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535886.687035:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3b15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.687043:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3b15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.687055:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a9888ad100) 00010000:00010000:3.0:1788535886.687058:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535886.687061:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3b15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.687068:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3b15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535886.689453:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535886.689714:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589209472 00000100:00100000:1.0:1788535886.689725:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589209472 00000100:00100000:1.0:1788535886.689774:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788535886.689782:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1875415589209472:12345-192.168.203.12@tcp:8:touch.500 00010000:00080000:1.0:1788535886.689832:0:6671:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:1.0:1788535886.689877:0:6671:0:(genops.c:1385:class_connect()) connect: client 30a1922d-0d3f-4681-a966-cec3672631c6, cookie 0x74f51638375d3b23 00002000:00100000:1.0:1788535886.689917:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 30a1922d-0d3f-4681-a966-cec3672631c6/ffff97a9bf1eb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788535886.689934:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788535886.690165:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788535886.690193:0:6671:0:(import.c:65:import_set_state_nolock()) ffff97a9bf1ef000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788535886.690253:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2354:x1875415589209472:12345-192.168.203.12@tcp:8:touch.500 Request processed in 470us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535886.690260:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788535886.696703:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535886.698073:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589209600 00000100:00100000:1.0:1788535886.698084:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589209600 00000100:00100000:1.0:1788535886.698167:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788535886.698177:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:0:x1875415589209600:12345-192.168.203.12@tcp:2:touch.500 00000100:00080000:0.0:1788535886.700487:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788535886.736559:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788535886.737974:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1788535886.737990:0:7609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 30a1922d-0d3f-4681-a966-cec3672631c6 00000100:00100000:2.0:1788535886.738146:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+5:0:x1875415589209600:12345-192.168.203.12@tcp:2:touch.500 Request processed in 39964us (41447us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788535886.738158:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1788535886.742932:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535886.743123:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589209856 00000100:00100000:0.0:1788535886.743133:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589209856 00000100:00100000:0.0:1788535886.743193:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1788535886.743204:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+10:9681:x1875415589209856:12345-192.168.203.12@tcp:35:touch.500 00000100:00100000:0.0:1788535886.743616:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+11:9681:x1875415589209856:12345-192.168.203.12@tcp:35:touch.500 Request processed in 412us (727us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788535886.743624:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1788535886.779155:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535886.785224:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589209984 00000100:00100000:1.0:1788535886.785254:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589209984 00000100:00100000:0.0:1788535886.790118:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:0.0:1788535886.790133:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+11:9682:x1875415589209984:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:0.0:1788535886.790158:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535886.790177:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2051800/0x74f51638375d3b2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751562f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.790238:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050e00/0x74f51638375d3b31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.790264:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050e00/0x74f51638375d3b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.790288:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050e00/0x74f51638375d3b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535886.790321:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788535886.790332:0:6697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535886.791008:0:6697:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050e00/0x74f51638375d3b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.791038:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2051800/0x74f51638375d3b2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751562f expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.791057:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050e00/0x74f51638375d3b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751562f expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.791067:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a9888ad900) 00010000:00010000:0.0:1788535886.791128:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788535886.791132:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c2050e00, rc 0) 00000100:00100000:0.0:1788535886.791258:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+12:9682:x1875415589209984:12345-192.168.203.12@tcp:101:rm.0 Request processed in 1127us (12112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535886.791265:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:1.0:1788535886.799768:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535886.799858:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589210240 00000100:00100000:0.0:1788535886.799876:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589210240 00000100:00100000:0.0:1788535886.799966:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:0.0:1788535886.799976:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+12:9682:x1875415589210240:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:0.0:1788535886.799997:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535886.800029:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2051800/0x74f51638375d3b38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515636 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535886.800126:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788535886.800277:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2051800/0x74f51638375d3b38 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515636 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.800291:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a99742a800) 00010000:00010000:0.0:1788535886.800294:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788535886.800299:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2051800/0x74f51638375d3b38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515636 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535886.800312:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c2051800, rc 0) 00000100:00100000:0.0:1788535886.800391:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+13:9682:x1875415589210240:12345-192.168.203.12@tcp:101:rm.0 Request processed in 416us (631us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788535886.800399:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:3.0:1788535886.805846:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535886.806299:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589210368 00000100:00100000:0.0:1788535886.806309:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589210368 00000100:00100000:0.0:1788535886.806516:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:0.0:1788535886.806630:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+13:9682:x1875415589210368:12345-192.168.203.12@tcp:37:rm.0 00000100:00100000:0.0:1788535886.814615:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+13:9682:x1875415589210368:12345-192.168.203.12@tcp:37:rm.0 Request processed in 7980us (8766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535886.814628:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1788535886.823494:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535886.823602:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589210624 00000100:00100000:2.0:1788535886.823612:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589210624 00000100:00100000:2.0:1788535886.823781:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1788535886.823797:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99c789850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+13:9682:x1875415589210624:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:2.0:1788535886.824316:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99c789850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+14:9682:x1875415589210624:12345-192.168.203.12@tcp:35:rm.0 Request processed in 519us (835us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788535886.824324:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788535886.827494:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535886.827624:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589210880 00000100:00100000:2.0:1788535886.827633:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589210880 00000100:00100000:2.0:1788535886.827691:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1788535886.827701:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+14:9682:x1875415589210880:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1788535886.827839:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535886.827861:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d3b46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751563d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.828075:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3b4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.828154:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3b4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.828166:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3b4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535886.828177:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788535886.828520:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d3b46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751563d expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.828541:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3b4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751563d expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.828549:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a9888ad900) 00010000:00010000:2.0:1788535886.828563:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788535886.828567:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747fe00, rc 0) 00000100:00100000:2.0:1788535886.828685:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+16:9682:x1875415589210880:12345-192.168.203.12@tcp:101:rm.0 Request processed in 985us (1200us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788535886.828692:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788535886.831744:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535886.831870:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589211008 00000100:00100000:0.0:1788535886.831880:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589211008 00000100:00100000:0.0:1788535886.831961:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1788535886.831973:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+16:9682:x1875415589211008:12345-192.168.203.12@tcp:41:rm.0 00000004:00000024:0.0:1788535886.832044:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788535886.832490:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+16:9682:x1875415589211008:12345-192.168.203.12@tcp:41:rm.0 Request processed in 518us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535886.832499:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:3.0:1788535886.836779:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535886.836974:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589211136 00000100:00100000:2.0:1788535886.836984:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589211136 00000100:00100000:2.0:1788535886.837177:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1788535886.837189:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+16:9682:x1875415589211136:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1788535886.837208:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535886.837229:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fa00/0x74f51638375d3b5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515644 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837301:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3b62 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837317:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3b62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837336:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3b62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837351:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3b69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837358:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837365:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837510:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3b70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837518:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3b70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837526:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3b70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535886.837553:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788535886.837557:0:6697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788535886.837573:0:6697:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3b70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837585:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3b70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837593:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3b62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837599:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3b62 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837605:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3b62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837611:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535886.837615:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3b62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837622:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3b62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837640:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a9888ad900) 00010000:00010000:2.0:1788535886.837643:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535886.837648:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3b62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837654:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d3b62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837669:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837675:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3b69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837680:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3b69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837685:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535886.837687:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3b69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837694:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3b69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837701:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff97a99742ae00) 00010000:00010000:2.0:1788535886.837703:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535886.837706:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3b69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837712:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3b69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837750:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fa00/0x74f51638375d3b5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515644 expref: 18 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837763:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3b70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515644 expref: 17 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.837770:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a9888ad100) 00010000:00010000:2.0:1788535886.837771:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535886.837774:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747f000, rc 0) 00000100:00100000:2.0:1788535886.837844:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+17:9682:x1875415589211136:12345-192.168.203.12@tcp:101:rm.0 Request processed in 657us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535886.837851:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:3.0:1788535886.842519:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535886.842616:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589211392 00000100:00100000:1.0:1788535886.842625:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589211392 00000100:00100000:1.0:1788535886.842681:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:1.0:1788535886.842692:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+17:9682:x1875415589211392:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1788535886.842847:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788535886.842992:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3b70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515644 expref: 17 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.843018:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050000/0x74f51638375d3b1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515628 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.843031:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a9888ad100) 00010000:00010000:1.0:1788535886.843045:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050e00/0x74f51638375d3b31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751562f expref: 15 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.843053:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a9888ad900) 00010000:00010000:1.0:1788535886.843057:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535886.843075:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b77 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.843203:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.843214:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.843230:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3b7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.843252:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3b7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.843260:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3b7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.843538:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b85 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.843547:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.843554:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788535886.844660:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788535886.844673:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 288975784928ns, next at 289975781663ns, rc = 0 00010000:00010000:1.0:1788535886.845615:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3b8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.845633:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.845643:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.845652:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3b8c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.845659:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3b8c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.845680:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3b8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846178:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788535886.846208:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846215:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b85 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846222:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b85 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846227:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0bc00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535886.846231:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b85 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846238:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b85 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846248:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:1.0:1788535886.846252:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788535886.846256:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b85 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846262:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b85 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846291:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846297:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b77 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846310:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846316:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535886.846319:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846334:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846342:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a9888ad900) 00010000:00010000:1.0:1788535886.846345:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535886.846348:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b77 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.846354:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788535886.846364:0:5834:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000ea4674c3 reply state 00000000451587aa transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3b7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535886.846373:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535886.846464:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+16:9682:x1875415589211392:12345-192.168.203.12@tcp:36:rm.0 Request processed in 3772us (3953us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788535886.846471:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00010000:00010000:3.0:1788535886.846732:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535886.846739:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3b8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.846752:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788535886.846755:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3b8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.846762:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3b8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.846770:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:3.0:1788535886.846773:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788535886.846776:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3b8c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.846782:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3b8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.846797:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535886.846798:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535886.846800:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535886.850028:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3b7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.850045:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3b7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.850052:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3b7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.850057:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535886.850062:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3b7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.850068:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3b7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.850083:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff97a9888ade00) 00010000:00010000:2.0:1788535886.850218:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535886.850224:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3b7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535886.850231:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3b7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535886.852517:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535886.852644:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589211648 00000100:00100000:2.0:1788535886.852654:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589211648 00000100:00100000:2.0:1788535886.852711:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788535886.852722:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+15:9682:x1875415589211648:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:2.0:1788535886.853022:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+16:9682:x1875415589211648:12345-192.168.203.12@tcp:35:rm.0 Request processed in 302us (512us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788535886.853031:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1788535886.860041:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535886.860419:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589211904 00000100:00100000:1.0:1788535886.860430:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589211904 00000100:00100000:1.0:1788535886.860496:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1788535886.860508:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+16:9682:x1875415589211904:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1788535886.860594:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788535886.860623:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3b4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751563d expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.860644:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3aeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751561a expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.860656:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a9888ad900) 00010000:00010000:1.0:1788535886.860673:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3aac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751560c expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.860683:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a99742a800) 00010000:00010000:1.0:1788535886.860690:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535886.860711:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b93 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.860734:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.860745:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.860759:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b9a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.860766:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.860772:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.861068:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3ba1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.861077:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3ba1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.861098:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3ba1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535886.861938:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788535886.861957:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3ba1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.861965:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3ba1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.861973:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3ba1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.861979:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535886.861984:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3ba1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.861992:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3ba1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.862002:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97a9888adb00) 00010000:00010000:1.0:1788535886.862005:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788535886.862009:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3ba1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.862026:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3ba1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.862046:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.862053:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b93 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.862060:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b93 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.862065:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535886.862068:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b93 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.862074:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b93 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.862082:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ad100) 00010000:00010000:1.0:1788535886.862085:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535886.862088:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b93 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535886.862093:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3b93 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788535886.862104:0:5833:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000001ba73774 reply state 0000000057bfcfee transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535886.862113:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535886.862204:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+15:9682:x1875415589211904:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1696us (2173us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788535886.862213:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00010000:00010000:3.0:1788535886.867531:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.867550:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b9a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.867558:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b9a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.867565:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0bc00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535886.867586:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b9a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.867596:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b9a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.867615:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97a9888ad600) 00010000:00010000:3.0:1788535886.867618:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535886.867623:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b9a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535886.867630:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3b9a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535887.117780:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535887.117815:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607068032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535887.117880:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535887.118047:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607068032 00000100:00100000:0.0:1788535887.118055:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607068032 00000100:00100000:0.0:1788535887.118120:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788535887.118130:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607068032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788535887.118162:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535887.118210:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607068032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535887.118217:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788535887.118274:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788535887.118462:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b7379180 x1875415607068032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535887.118481:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607068032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788535887.763637:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535888.782546:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535889.809640:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535890.702069:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607068544:0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.702136:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535890.702193:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535890.702199:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf15c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607068416:0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.702226:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535890.702260:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607068544 00000100:00100000:1.0:1788535890.702266:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607068544 00000100:00100000:1.0:1788535890.702315:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788535890.702323:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607068544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.702368:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607068544:12345-0@lo:400:kworker.0 Request processed in 46us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.702374:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788535890.702395:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607068416 00000100:00100000:1.0:1788535890.702398:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607068416 00000100:00100000:1.0:1788535890.702421:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788535890.702428:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607068416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.702454:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607068416:12345-0@lo:400:kworker.0 Request processed in 28us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.702460:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788535890.702473:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788535890.702492:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788535890.702521:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf15c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607068416:0@lo:400:kworker.0 00010000:00080000:1.0:1788535890.702533:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf15ed80 x1875415607068544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535890.702551:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607068544:0@lo:400:kworker.0 00000100:00100000:3.0:1788535890.702745:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607068288:0@lo:400:kworker.0 00000100:00100000:3.0:1788535890.702785:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535890.702810:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607068800:0@lo:400:kworker.0 00000100:00100000:3.0:1788535890.702832:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535890.702857:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788535890.702862:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607068160:0@lo:400:kworker.0 00000100:00100000:3.0:1788535890.702913:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535890.702932:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607068672:0@lo:400:kworker.0 00000100:00100000:3.0:1788535890.702953:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535890.702980:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607068800 00000100:00100000:3.0:1788535890.703000:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607068800 00000100:00100000:3.0:1788535890.703034:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788535890.703043:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607068800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535890.703077:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607068800:12345-0@lo:400:kworker.0 Request processed in 37us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535890.703083:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788535890.703099:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607068288 00000100:00100000:3.0:1788535890.703103:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607068288 00000100:00100000:3.0:1788535890.703122:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607068672 00000100:00100000:3.0:1788535890.703125:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607068672 00000100:00100000:3.0:1788535890.703143:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788535890.703150:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607068288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535890.703178:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607068288:12345-0@lo:400:kworker.0 Request processed in 28us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535890.703184:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788535890.703195:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788535890.703202:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875415607068672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535890.703226:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875415607068672:12345-0@lo:400:kworker.0 Request processed in 26us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535890.703232:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788535890.703246:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788535890.703249:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535890.703266:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607068672:0@lo:400:kworker.0 00000100:00100000:3.0:1788535890.703276:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607068288:0@lo:400:kworker.0 00010000:00080000:3.0:1788535890.703286:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d04e00 x1875415607068800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535890.703307:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607068800:0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.703621:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607068160 00000100:00100000:1.0:1788535890.703626:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607068160 00000100:00100000:1.0:1788535890.703662:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788535890.703669:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3309:x1875415607068160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.703702:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3309:x1875415607068160:12345-0@lo:400:kworker.0 Request processed in 34us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.703708:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788535890.703867:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607068160:0@lo:400:kworker.0 00000100:00100000:3.0:1788535890.803816:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535890.804879:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589212032 00000100:00100000:1.0:1788535890.804907:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589212032 00000100:00100000:3.0:1788535890.804915:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535890.804957:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:3.0:1788535890.804965:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535890.804967:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2355:x1875415589212032:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535890.804995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535890.805018:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589212160 00000100:00100000:3.0:1788535890.805022:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589212160 00000100:00100000:1.0:1788535890.805178:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2355:x1875415589212032:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 210us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.805187:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:0.0:1788535890.805360:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589212288 00000100:00100000:0.0:1788535890.805365:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589212288 00000100:00100000:0.0:1788535890.805417:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788535890.805428:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+5:2355:x1875415589212288:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535890.805463:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+5:2355:x1875415589212288:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535890.805470:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788535890.805883:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589212416 00000100:00100000:3.0:1788535890.805907:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589212416 00000100:00080000:1.0:1788535890.806957:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535890.806963:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535890.807332:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:0.0:1788535890.807369:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+14:2355:x1875415589212160:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535890.807439:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+14:2355:x1875415589212160:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 96us (2472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535890.807448:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:0.0:1788535890.807466:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:0.0:1788535890.807486:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2355:x1875415589212416:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535890.807513:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2355:x1875415589212416:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535890.807519:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00010000:00010000:2.0:1788535890.829718:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788535891.143966:0:11573:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:2.0:1788535891.213071:0:8006:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 293344180765ns, next at 294344178032ns, rc = 0 00000100:00100000:2.0:1788535891.213118:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607068928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535891.213201:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535891.213637:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607068928 00000100:00100000:2.0:1788535891.213646:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607068928 00000100:00100000:2.0:1788535891.213706:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788535891.213878:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b737b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607068928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535891.213960:0:10342:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788535891.214432:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b737b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607068928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 716us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535891.214451:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788535891.214491:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b7379180 x1875415607068928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535891.214508:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607068928:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788535891.822815:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000001:00080000:0.0:1788535891.822839:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788535891.822846:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:0.0:1788535891.822868:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:3.0:1788535891.823061:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535891.823081:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607069056:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788535891.823146:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535891.823205:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607069056 00000100:00100000:3.0:1788535891.823410:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607069056 00000100:00100000:3.0:1788535891.823466:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788535891.823476:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607069056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788535891.823500:0:6673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788535891.823531:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ae44e, atime: 0x6a9ae44e, ctime: 0x6a9ae44e, blocks: 0x1 00010000:00010000:3.0:1788535891.823538:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d3ba8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.823553:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=293s v=(0 0) 00010000:00010000:3.0:1788535891.823558:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535891.823564:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d3ba8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.823600:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d3ba8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.823612:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d3ba8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.823731:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d3ba8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.824125:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788535891.824875:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875415607069056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1397us (1726us total) trans 4294967300 rc 0/0 00010000:00010000:0.0:1788535891.825222:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535891.825230:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d3ba8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535891.825247:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4aa00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788535891.825252:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d3ba8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535891.825261:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d3ba8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535891.825280:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d3ba8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535891.825288:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d3ba8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535891.825306:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535891.825308:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535891.825317:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535891.825758:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1788535891.826590:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a9b7054000/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788535891.826600:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607069056:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788535891.855354:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788535892.086354:0:11622:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffad814900 20000000:00000080:3.0:1788535892.086371:0:11622:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a9bfd1f800 uarg=0000000000000000 20000000:01000000:3.0:1788535892.086404:0:11622:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788535892.086410:0:11622:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788535892.086414:0:11622:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788535892.087054:0:11623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788535892.087191:0:11622:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788535892.091394:0:11622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788535892.091443:0:11622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788535892.091492:0:11622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788535892.091507:0:11622:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788535892.091531:0:11622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535892.091548:0:11622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981653c00/0x74f51638375d3a4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155f7 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535892.091556:0:11622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981653e00/0x74f51638375d3a51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155fe expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535892.091563:0:11622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9b747e600/0x74f51638375d3a5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3a58 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535892.091569:0:11622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a981652c00/0x74f51638375d3a6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3a66 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535892.091576:0:11622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9c2050600/0x74f51638375d3a7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3a74 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535892.091583:0:11622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535892.091618:0:11622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9c2050600/0x74f51638375d3a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d3a74 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535892.091632:0:11622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a9c2050600/0x74f51638375d3a7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d3a74 expref: 18 pid: 5826 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535892.091644:0:11622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7057100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11622:1875415607069184:0@lo:104: 00000100:00100000:3.0:1788535892.091700:0:11622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788535892.091753:0:11622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981652c00/0x74f51638375d3a6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d3a66 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535892.091783:0:11622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a981652c00/0x74f51638375d3a6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d3a66 expref: 18 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535892.091792:0:11622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7057800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11622:1875415607069312:0@lo:104: 00000100:00100000:3.0:1788535892.091814:0:11622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788535892.091837:0:11622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9b747e600/0x74f51638375d3a5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d3a58 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535892.091846:0:11622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97a9b747e600/0x74f51638375d3a5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d3a58 expref: 18 pid: 5826 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535892.091853:0:11622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7055180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11622:1875415607069440:0@lo:104: 00000100:00100000:3.0:1788535892.091875:0:11622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788535892.091927:0:11622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981653e00/0x74f51638375d3a51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155fe expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535892.091938:0:11622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a981653e00/0x74f51638375d3a51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155fe expref: 12 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535892.091946:0:11622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7055500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11622:1875415607069568:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788535892.092239:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788535892.092253:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607069184 00000100:00100000:1.0:1788535892.092258:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607069184 00000100:00100000:1.0:1788535892.092290:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607069312 00000100:00100000:1.0:1788535892.092293:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607069312 00000100:00100000:1.0:1788535892.092301:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607069440 00000100:00100000:1.0:1788535892.092303:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607069440 00000100:00100000:1.0:1788535892.092313:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788535892.092321:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:11622:x1875415607069184:12345-0@lo:104: 00010000:00010000:1.0:1788535892.092339:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3a7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092387:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788535892.092393:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+5:11622:x1875415607069184:12345-0@lo:104: Request processed in 73us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535892.092400:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788535892.092416:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788535892.092421:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+4:11622:x1875415607069312:12345-0@lo:104: 00010000:00010000:1.0:1788535892.092427:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3a6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092456:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788535892.092460:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+4:11622:x1875415607069312:12345-0@lo:104: Request processed in 40us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535892.092465:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788535892.092477:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788535892.092482:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bfdfe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:11622:x1875415607069440:12345-0@lo:104: 00010000:00010000:1.0:1788535892.092488:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3a5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092513:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788535892.092518:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bfdfe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+3:11622:x1875415607069440:12345-0@lo:104: Request processed in 36us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535892.092523:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788535892.092554:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788535892.092559:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3a7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092571:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981653600 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:1.0:1788535892.092575:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d3a7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092584:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d3a7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535892.092591:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d3a7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535892.092596:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535892.092622:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092628:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535892.092646:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092653:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a981653600/0x74f51638375d3a74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092665:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788535892.092668:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3a6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092674:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e200 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:1.0:1788535892.092677:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d3a6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092693:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d3a6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535892.092700:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d3a6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535892.092705:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535892.092716:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092722:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535892.092727:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092733:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9b747e200/0x74f51638375d3a66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092742:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535892.092744:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d3a5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092750:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981653000 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:1.0:1788535892.092753:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d3a5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092759:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d3a5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535892.092775:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d3a5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535892.092786:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535892.092799:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092804:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535892.092822:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092828:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a981653000/0x74f51638375d3a58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d3a5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.092839:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535892.092841:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535892.092842:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535892.092854:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607069696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535892.092881:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535892.092932:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535892.092938:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607069824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535892.092955:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535892.092979:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607069952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535892.093003:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535892.093027:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607069696 00000100:00100000:1.0:1788535892.093031:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607069696 00010000:00010000:1.0:1788535892.093047:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9c2050600/0x74f51638375d3a7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3a74 expref: 19 pid: 5826 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535892.093064:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607069824 00000100:00100000:1.0:1788535892.093066:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607069824 00010000:00010000:1.0:1788535892.093081:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981652c00/0x74f51638375d3a6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3a66 expref: 20 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535892.093090:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607069952 00000100:00100000:1.0:1788535892.093093:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607069952 00010000:00010000:1.0:1788535892.093101:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9b747e600/0x74f51638375d3a5f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3a58 expref: 21 pid: 5826 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535892.093110:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788535892.093115:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+21:3308:x1875415607069696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788535892.093123:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535892.093128:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9c2050600/0x74f51638375d3a7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3a74 expref: 21 pid: 5826 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.093137:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9c2050600/0x74f51638375d3a7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d3a74 expref: 21 pid: 5826 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.093151:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535892.093176:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+21:3308:x1875415607069696:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535892.093182:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788535892.093194:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788535892.093199:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+20:3308:x1875415607069824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788535892.093206:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535892.093211:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981652c00/0x74f51638375d3a6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3a66 expref: 20 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.093219:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981652c00/0x74f51638375d3a6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d3a66 expref: 20 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.093236:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535892.093258:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+20:3308:x1875415607069824:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535892.093263:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788535892.093274:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788535892.093279:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607069952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788535892.093285:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535892.093289:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9b747e600/0x74f51638375d3a5f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d3a58 expref: 19 pid: 5826 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.093296:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9b747e600/0x74f51638375d3a5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d3a58 expref: 19 pid: 5826 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535892.093304:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535892.093324:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607069952:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535892.093329:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788535892.093379:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607069952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535892.093401:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607069824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535892.093408:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607069696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535892.093732:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1788535892.093780:0:11622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a981653c00/0x74f51638375d3a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155f7 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535892.093790:0:11622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a981653c00/0x74f51638375d3a4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155f7 expref: 12 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535892.093800:0:11622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7056d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11622:1875415607070080:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535892.093850:0:11622:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b6c14c00 going to sleep for 11 seconds 00010000:00010000:3.0:1788535892.093863:0:11622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9c2050600/0x74f51638375d3a7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d3a74 expref: 18 pid: 5826 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535892.093875:0:11622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7057100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11622:1875415607069184:0@lo:104: 00010000:00010000:3.0:1788535892.093884:0:11622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981652c00/0x74f51638375d3a6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d3a66 expref: 17 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535892.093912:0:11622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7057800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11622:1875415607069312:0@lo:104: 00010000:00010000:3.0:1788535892.093921:0:11622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9b747e600/0x74f51638375d3a5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d3a58 expref: 16 pid: 5826 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535892.093928:0:11622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7055180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11622:1875415607069440:0@lo:104: 00000100:00100000:3.0:1788535892.093934:0:11622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7055500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11622:1875415607069568:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535892.097963:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535892.097974:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535892.098005:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589212544 00000100:00100000:0.0:1788535892.098015:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589212544 00010000:00010000:0.0:1788535892.098058:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981653e00/0x74f51638375d3a51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155fe expref: 13 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535892.098101:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788535892.098110:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7054a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2355:x1875415589212544:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535892.098123:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535892.098128:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981653e00/0x74f51638375d3a51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155fe expref: 13 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.098140:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981653e00/0x74f51638375d3a51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155fe expref: 13 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.098157:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981653e00/0x74f51638375d3a51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155fe expref: 13 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.098172:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535892.098222:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7054a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:2355:x1875415589212544:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 113us (4490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535892.098228:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:3.0:1788535892.102668:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535892.102757:0:11622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7056d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11622:1875415607070080:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535892.102808:0:11622:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535892.103042:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589212672 00000100:00100000:0.0:1788535892.103103:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589212672 00010000:00010000:0.0:1788535892.103137:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a981653c00/0x74f51638375d3a4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155f7 expref: 12 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535892.103219:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1788535892.103229:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:2356:x1875415589212672:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535892.103252:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535892.103258:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a981653c00/0x74f51638375d3a4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155f7 expref: 12 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.103270:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a981653c00/0x74f51638375d3a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155f7 expref: 12 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.103288:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981653c00/0x74f51638375d3a4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155f7 expref: 12 pid: 5827 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.103305:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.103314:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.103328:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.103335:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.103341:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.103348:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.103364:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b200 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788535892.103368:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.103377:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535892.104271:0:11622:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535892.104284:0:11622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.105402:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.105415:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4b200/0x74f51638375d3baf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535892.105432:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535892.106129:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:2356:x1875415589212672:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 2895us (3463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535892.106138:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1788535892.241188:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535892.241210:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607070208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535892.241276:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535892.241367:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607070208 00000100:00100000:0.0:1788535892.241375:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607070208 00000100:00100000:0.0:1788535892.241432:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788535892.241441:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607070208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788535892.241470:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535892.241513:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607070208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535892.241519:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788535892.241554:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9c0815500 x1875415607070208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535892.241572:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607070208:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788535892.241625:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788535892.877274:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788535893.709146:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788535893.709154:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a986ffc800 from 7 10000000:01000000:0.0:1788535893.709158:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788535893.709205:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535893.709218:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535893.709230:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535893.709265:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607070336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788535893.709332:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535893.709390:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b93066c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535893.709961:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607070336 00000100:00100000:2.0:1788535893.709969:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607070336 00000100:00100000:2.0:1788535893.710028:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788535893.710045:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:5830:x1875415607070336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535893.710058:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535893.710073:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b747e000/0x74f51638375d3bbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3bb6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535893.710110:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b747e000/0x74f51638375d3bbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3bb6 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535893.710140:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b747e000/0x74f51638375d3bbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3bb6 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535893.710150:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747e000, rc 0) 00000100:00100000:2.0:1788535893.710206:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607070336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535893.710213:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788535893.711155:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607070336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535893.711176:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535893.711186:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535893.711270:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607070464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535893.711308:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535893.711344:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b93066c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535893.711451:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607070464 00000100:00100000:1.0:1788535893.711457:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607070464 00000100:00100000:1.0:1788535893.711497:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788535893.711504:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607070464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535893.711724:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607070464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535893.711731:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788535893.711983:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607070464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535893.712010:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607070592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535893.712060:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535893.712089:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b93066c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535893.712190:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607070592 00000100:00100000:3.0:1788535893.712195:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607070592 00000100:00100000:3.0:1788535893.712228:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788535893.712237:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986eda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607070592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535893.712396:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986eda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607070592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535893.712402:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788535893.712851:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607070592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535893.716187:0:11635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:11635:1875415607070720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535893.716345:0:11635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535893.716395:0:11635:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b9306c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535893.716462:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607070720 00000100:00100000:2.0:1788535893.716469:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607070720 00000100:00100000:2.0:1788535893.716517:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788535893.716526:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:11635:x1875415607070720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535893.716769:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:11635:x1875415607070720:12345-0@lo:502:llog_process_th.0 Request processed in 231us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535893.716778:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788535893.716942:0:11635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:11635:1875415607070720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788535893.716971:0:11635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788535893.716980:0:11635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535893.716982:0:11635:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788535893.716988:0:11635:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a986ffc800 00000020:00000080:0.0:1788535893.716991:0:11635:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788535893.717062:0:11635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:11635:1875415607070848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535893.717093:0:11635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535893.717119:0:11635:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b9306c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788535893.717336:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607070848 00000100:00100000:1.0:1788535893.717341:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607070848 00000100:00100000:1.0:1788535893.717375:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788535893.717383:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:11635:x1875415607070848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535893.717523:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:11635:x1875415607070848:12345-0@lo:502:llog_process_th.0 Request processed in 140us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535893.717531:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788535893.717609:0:11635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:11635:1875415607070848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788535893.717630:0:11635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788535893.717634:0:11635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535893.717636:0:11635:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788535893.717640:0:11635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788535893.717864:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788535893.717932:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788535893.717941:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535893.717952:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535893.717961:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788535893.717963:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a9a7dac800 from 7 10000000:01000000:3.0:1788535893.717966:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788535893.717989:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535893.717997:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535893.718006:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535893.718020:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607070976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788535893.718049:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535893.718071:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b6c14600 going to sleep for 11 seconds 00000100:00100000:3.0:1788535893.718092:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607070976 00000100:00100000:3.0:1788535893.718095:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607070976 00000100:00100000:3.0:1788535893.718121:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788535893.718127:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:5830:x1875415607070976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535893.718137:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535893.718148:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a98ab4ba00/0x74f51638375d3bcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3bc4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535893.718190:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4ba00/0x74f51638375d3bcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3bc4 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535893.718200:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a98ab4ba00/0x74f51638375d3bcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3bc4 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535893.718208:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4ba00, rc 0) 00000100:00100000:3.0:1788535893.718243:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607070976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535893.718249:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788535893.719097:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607070976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535893.719119:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535893.719129:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535893.719197:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607071104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535893.719238:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535893.719277:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b7060d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788535893.720334:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607071104 00000100:00100000:3.0:1788535893.720342:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607071104 00000100:00100000:3.0:1788535893.720374:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788535893.720381:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607071104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535893.720629:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607071104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535893.720637:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788535893.721155:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607071104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535893.721204:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607071232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535893.721268:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535893.721303:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b9306c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788535893.721398:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607071232 00000100:00100000:1.0:1788535893.721403:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607071232 00000100:00100000:1.0:1788535893.721447:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788535893.721454:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607071232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535893.721594:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607071232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535893.721609:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788535893.721962:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607071232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535893.722312:0:11637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:11637:1875415607071360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535893.722349:0:11637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535893.722380:0:11637:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b9306180 going to sleep for 11 seconds 00000100:00100000:1.0:1788535893.722467:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607071360 00000100:00100000:1.0:1788535893.722471:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607071360 00000100:00100000:1.0:1788535893.722510:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788535893.722525:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:11637:x1875415607071360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535893.722703:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:11637:x1875415607071360:12345-0@lo:502:llog_process_th.0 Request processed in 186us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535893.722710:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788535893.722746:0:11637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:11637:1875415607071360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788535893.722777:0:11637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535893.722785:0:11637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535893.722788:0:11637:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788535893.722817:0:11637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a9a7dac800 00000020:00000080:1.0:1788535893.722820:0:11637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788535893.728020:0:11637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:11637:1875415607071488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535893.728108:0:11637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535893.728150:0:11637:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b7060a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788535893.728310:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607071488 00000100:00100000:3.0:1788535893.728317:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607071488 00000100:00100000:3.0:1788535893.728372:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788535893.728381:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:11637:x1875415607071488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535893.728609:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:11637:x1875415607071488:12345-0@lo:502:llog_process_th.0 Request processed in 227us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535893.728617:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788535893.736581:0:11637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:11637:1875415607071488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788535893.736636:0:11637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535893.736649:0:11637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535893.736652:0:11637:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788535893.736668:0:11637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788535893.736773:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788535893.736794:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788535893.736816:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535893.736828:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535893.736840:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788535893.736843:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a9ac46a000 from 7 10000000:01000000:3.0:1788535893.736846:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788535893.736883:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535893.736931:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535893.736940:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535893.736960:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7055880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607071616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788535893.737016:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535893.737051:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b6c14f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788535893.737068:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607071616 00000100:00100000:3.0:1788535893.737074:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607071616 00000100:00100000:3.0:1788535893.737115:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788535893.737124:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:5830:x1875415607071616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535893.737136:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535893.737149:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a98ab4aa00/0x74f51638375d3bd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d3bd2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535893.737172:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4aa00/0x74f51638375d3bd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d3bd2 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535893.737188:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a98ab4aa00/0x74f51638375d3bd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d3bd2 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535893.737196:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4aa00, rc 0) 00000100:00100000:3.0:1788535893.737237:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607071616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535893.737243:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788535893.737993:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7055880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607071616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535893.738012:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535893.738043:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535893.738105:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607071744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535893.738151:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535893.738178:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b7060a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788535893.738290:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607071744 00000100:00100000:3.0:1788535893.738295:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607071744 00000100:00100000:3.0:1788535893.738335:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788535893.738353:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607071744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535893.738605:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607071744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535893.738613:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788535893.738731:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607071744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535893.738773:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607071872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535893.738808:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535893.738829:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b7060a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788535893.738871:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607071872 00000100:00100000:3.0:1788535893.738875:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607071872 00000100:00100000:3.0:1788535893.738926:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788535893.738933:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607071872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535893.739061:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:5830:x1875415607071872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535893.739068:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788535893.739269:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea5d41c9-12b3-443f-877d-8b3d703772fc:5830:1875415607071872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535893.739659:0:11639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7054e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:11639:1875415607072000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535893.739693:0:11639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535893.739746:0:11639:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b6c14600 going to sleep for 11 seconds 00000100:00100000:1.0:1788535893.741588:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607072000 00000100:00100000:1.0:1788535893.741601:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607072000 00000100:00100000:1.0:1788535893.741654:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788535893.741663:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:11639:x1875415607072000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535893.741938:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:11639:x1875415607072000:12345-0@lo:502:llog_process_th.0 Request processed in 275us (2243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535893.741946:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788535893.742968:0:11639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7054e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:11639:1875415607072000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535893.743011:0:11639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535893.743031:0:11639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535893.743034:0:11639:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788535893.743041:0:11639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a9ac46a000 00000020:00000080:2.0:1788535893.743044:0:11639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788535893.743131:0:11639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:11639:1875415607072128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535893.743183:0:11639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535893.743223:0:11639:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987b51e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535893.743470:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607072128 00000100:00100000:3.0:1788535893.743482:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607072128 00000100:00100000:3.0:1788535893.743519:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788535893.743527:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:11639:x1875415607072128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535893.743703:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:11639:x1875415607072128:12345-0@lo:502:llog_process_th.0 Request processed in 177us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535893.743711:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788535893.743748:0:11639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea5d41c9-12b3-443f-877d-8b3d703772fc:11639:1875415607072128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788535893.743777:0:11639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535893.743782:0:11639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535893.743783:0:11639:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788535893.743788:0:11639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788535893.744109:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788535893.744126:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788535893.744136:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535893.744149:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788535893.744334:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788535893.758871:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535893.766536:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589212800 00000100:00100000:1.0:1788535893.766552:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589212800 00000100:00100000:1.0:1788535893.766624:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 257 00000100:00100000:1.0:1788535893.766634:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:5595:x1875415589212800:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535893.766651:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535893.766668:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d3be0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751564b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535893.766695:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d3be0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751564b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535893.766706:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d3be0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751564b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535893.766715:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a600, rc 0) 00000100:00100000:1.0:1788535893.766791:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:5595:x1875415589212800:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 158us (7929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535893.766799:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 257 00000100:00100000:0.0:1788535893.775047:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535893.775078:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589212928 00000100:00100000:0.0:1788535893.775088:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589212928 00000100:00100000:0.0:1788535893.775135:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 258 00000100:00100000:0.0:1788535893.775145:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:5595:x1875415589212928:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535893.776358:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:5595:x1875415589212928:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 1207us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535893.776370:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 258 00000100:00100000:3.0:1788535893.792642:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535893.793067:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589213056 00000100:00100000:0.0:1788535893.793078:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589213056 00000100:00100000:0.0:1788535893.793128:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 259 00000100:00100000:0.0:1788535893.793138:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:5595:x1875415589213056:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535893.793367:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:5595:x1875415589213056:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 229us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535893.793375:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 259 00000100:00100000:1.0:1788535893.805523:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535893.805810:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589213184 00000100:00100000:0.0:1788535893.805820:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589213184 00000100:00100000:0.0:1788535893.805872:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 260 00000100:00100000:0.0:1788535893.805882:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:9953:x1875415589213184:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788535893.806131:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:9953:x1875415589213184:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 250us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535893.806146:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 260 00000100:00100000:0.0:1788535893.808993:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535893.809092:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589213312 00000100:00100000:3.0:1788535893.809110:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589213312 00000100:00100000:3.0:1788535893.809197:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 261 00000100:00100000:3.0:1788535893.809211:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:9953:x1875415589213312:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788535893.810139:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:9953:x1875415589213312:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 924us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535893.810153:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 261 00000100:00100000:0.0:1788535893.817168:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535893.817250:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589213440 00000100:00100000:2.0:1788535893.817260:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589213440 00000100:00100000:2.0:1788535893.817320:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 262 00000100:00100000:2.0:1788535893.817343:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:5595:x1875415589213440:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535893.817361:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535893.817382:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b747f200/0x74f51638375d3be7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515652 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535893.817414:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b747f200/0x74f51638375d3be7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515652 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535893.817425:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b747f200/0x74f51638375d3be7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515652 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535893.817434:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747f200, rc 0) 00000100:00100000:2.0:1788535893.817486:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:5595:x1875415589213440:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 145us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535893.817493:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 262 00000100:00100000:1.0:1788535893.828374:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535893.828462:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589213568 00000100:00100000:3.0:1788535893.828480:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589213568 00000100:00100000:3.0:1788535893.828569:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 263 00000100:00100000:3.0:1788535893.828582:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:5595:x1875415589213568:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535893.829052:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:5595:x1875415589213568:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 470us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535893.829062:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 263 00000100:00100000:3.0:1788535893.834746:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535893.835526:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589213696 00000100:00100000:0.0:1788535893.835544:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589213696 00000100:00100000:0.0:1788535893.835615:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 264 00000100:00100000:0.0:1788535893.835627:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:5595:x1875415589213696:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535893.835879:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:5595:x1875415589213696:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 254us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535893.835929:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 264 00000100:00100000:0.0:1788535893.851567:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535893.851679:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589213824 00000100:00100000:2.0:1788535893.851689:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589213824 00000100:00100000:2.0:1788535893.851743:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 265 00000100:00100000:2.0:1788535893.851764:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:9956:x1875415589213824:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788535893.852067:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:9956:x1875415589213824:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 315us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535893.852076:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 265 00000100:00100000:1.0:1788535893.861539:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535893.864872:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589213952 00000100:00100000:0.0:1788535893.864933:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589213952 00000100:00100000:0.0:1788535893.865005:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 266 00000100:00100000:0.0:1788535893.865016:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:9956:x1875415589213952:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788535893.865285:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:9956:x1875415589213952:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 269us (3761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535893.865293:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 266 00010000:00010000:0.0:1788535893.901303:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788535894.802776:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788535894.927015:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535895.821522:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607072640:0@lo:400:kworker.0 00000100:00100000:2.0:1788535895.821665:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535895.821676:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607072256:0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.821738:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535895.821794:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607072768:0@lo:400:kworker.0 00000100:00100000:2.0:1788535895.821799:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535895.821808:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607072512:0@lo:400:kworker.0 00000100:00100000:0.0:1788535895.821823:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607072640 00000100:00100000:0.0:1788535895.821839:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607072640 00000100:00100000:1.0:1788535895.821877:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535895.821930:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788535895.821937:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b737b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607072384:0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.821968:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535895.821991:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607072896:0@lo:400:kworker.0 00000100:00100000:0.0:1788535895.822003:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788535895.822019:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607072640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.822034:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535895.822082:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607072768 00000100:00100000:3.0:1788535895.822085:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607072896 00000100:00100000:1.0:1788535895.822089:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607072768 00000100:00100000:3.0:1788535895.822093:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607072896 00000100:00100000:0.0:1788535895.822103:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607072640:12345-0@lo:400:kworker.0 Request processed in 88us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535895.822124:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788535895.822138:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607072384 00000100:00100000:3.0:1788535895.822143:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788535895.822145:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607072384 00000100:00100000:3.0:1788535895.822154:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875415607072896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.822207:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875415607072896:12345-0@lo:400:kworker.0 Request processed in 56us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535895.822214:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788535895.822232:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788535895.822245:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607072768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.822249:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788535895.822285:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607072768:12345-0@lo:400:kworker.0 Request processed in 44us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535895.822292:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788535895.822322:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607072256 00000100:00100000:0.0:1788535895.822326:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607072256 00000100:00100000:0.0:1788535895.822358:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788535895.822359:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535895.822365:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607072256:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788535895.822399:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b9309180 x1875415607072640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535895.822412:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607072256:12345-0@lo:400:kworker.0 Request processed in 48us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535895.822416:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607072640:0@lo:400:kworker.0 00000100:00100000:0.0:1788535895.822419:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788535895.822444:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607072512 00000100:00100000:0.0:1788535895.822447:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607072512 00000100:00080000:2.0:1788535895.822463:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788535895.822467:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788535895.822468:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535895.822471:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535895.822472:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607072512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.822492:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788535895.822505:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788535895.822507:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607072512:12345-0@lo:400:kworker.0 Request processed in 33us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535895.822516:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788535895.822547:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607072512:0@lo:400:kworker.0 00000100:00100000:0.0:1788535895.822594:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607072896:0@lo:400:kworker.0 00000100:00100000:0.0:1788535895.822604:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607072256:0@lo:400:kworker.0 00000100:00100000:0.0:1788535895.822614:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607072768:0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.822821:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607072384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.822876:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607072384:12345-0@lo:400:kworker.0 Request processed in 619us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535895.822884:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788535895.822951:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b737b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607072384:0@lo:400:kworker.0 00000100:00100000:2.0:1788535895.925240:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535895.925408:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535895.925433:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535895.925536:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589214080 00000100:00100000:3.0:1788535895.925550:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589214080 00000100:00100000:3.0:1788535895.925626:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 268 00000100:00100000:3.0:1788535895.925638:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2357:x1875415589214080:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535895.925725:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2357:x1875415589214080:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 89us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535895.925734:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 268 00000100:00100000:3.0:1788535895.937575:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535895.937939:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589214336 00000100:00100000:2.0:1788535895.937953:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589214336 00000100:00100000:2.0:1788535895.938062:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1788535895.938075:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+5:2357:x1875415589214336:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:3.0:1788535895.938254:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788535895.938367:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+5:2357:x1875415589214336:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 293us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535895.938376:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1788535895.938666:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589214208 00000100:00100000:1.0:1788535895.938667:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589214464 00000100:00100000:1.0:1788535895.938675:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589214464 00000100:00100000:0.0:1788535895.938675:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589214208 00000100:00100000:1.0:1788535895.938785:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:1.0:1788535895.938794:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589214464:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535895.938834:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589214464:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 42us (13400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535895.938840:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:1.0:1788535895.939138:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:1.0:1788535895.939146:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589214208:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535895.939189:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589214208:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (13981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535895.939195:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00080000:3.0:1788535895.939412:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788535895.949117:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535896.333360:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607073024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535896.333454:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535896.333669:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607073024 00000100:00100000:2.0:1788535896.333681:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607073024 00000100:00100000:2.0:1788535896.333759:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788535896.333771:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875415607073024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535896.333820:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788535896.334511:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875415607073024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 737us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535896.334522:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788535896.335136:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607073024:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788535896.937527:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1788535896.974444:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535897.358631:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535897.358691:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607073152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535897.358786:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535897.358973:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607073152 00000100:00100000:0.0:1788535897.358984:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607073152 00000100:00100000:0.0:1788535897.359060:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788535897.359069:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607073152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788535897.359108:0:10342:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535897.359170:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607073152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535897.359177:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788535897.359559:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788535897.360206:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9c0816d80 x1875415607073152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535897.360245:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607073152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788535897.997921:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535899.021408:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535900.045255:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535900.941493:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607073408:0@lo:400:kworker.0 00000100:00100000:3.0:1788535900.941545:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607073280:0@lo:400:kworker.0 00000100:00100000:2.0:1788535900.941589:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535900.941630:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535900.941698:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607073792:0@lo:400:kworker.0 00000100:00100000:2.0:1788535900.941717:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607073920:0@lo:400:kworker.0 00000100:00100000:3.0:1788535900.941760:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535900.941772:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535900.941817:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607073536:0@lo:400:kworker.0 00000100:00100000:2.0:1788535900.941843:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607073408 00000100:00100000:2.0:1788535900.941854:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607073408 00000100:00100000:3.0:1788535900.941860:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535900.941927:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535900.941936:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607073664:0@lo:400:kworker.0 00000100:00100000:2.0:1788535900.941943:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607073792 00000100:00100000:2.0:1788535900.941948:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607073792 00000100:00100000:3.0:1788535900.941973:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535900.941984:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607073536 00000100:00100000:2.0:1788535900.941989:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607073536 00000100:00100000:3.0:1788535900.942023:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607073920 00000100:00100000:3.0:1788535900.942031:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607073920 00000100:00100000:3.0:1788535900.942075:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607073664 00000100:00100000:3.0:1788535900.942078:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607073664 00000100:00100000:3.0:1788535900.942105:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788535900.942120:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607073920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535900.942182:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607073920:12345-0@lo:400:kworker.0 Request processed in 68us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535900.942190:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788535900.942218:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788535900.942229:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607073664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535900.942234:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607073280 00000100:00100000:0.0:1788535900.942241:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607073280 00000100:00100000:3.0:1788535900.942275:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607073664:12345-0@lo:400:kworker.0 Request processed in 47us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535900.942287:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788535900.942294:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788535900.942305:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607073280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535900.942347:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788535900.942360:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986aa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607073408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535900.942386:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607073280:12345-0@lo:400:kworker.0 Request processed in 81us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535900.942395:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788535900.942419:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986aa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607073408:12345-0@lo:400:kworker.0 Request processed in 60us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535900.942429:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788535900.942451:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788535900.942562:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607073792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535900.942610:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607073792:12345-0@lo:400:kworker.0 Request processed in 150us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535900.944349:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788535900.944380:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607073536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535900.944499:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607073536:12345-0@lo:400:kworker.0 Request processed in 136us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535900.948940:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607073280:0@lo:400:kworker.0 00000100:00100000:1.0:1788535900.948984:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607073792:0@lo:400:kworker.0 00000100:00100000:3.0:1788535900.949055:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788535900.949118:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535900.949127:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535900.949133:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788535900.949211:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b7055500 x1875415607073664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535900.949225:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607073664:0@lo:400:kworker.0 00000100:00100000:1.0:1788535900.949246:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607073536:0@lo:400:kworker.0 00000100:00100000:1.0:1788535900.949285:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788535900.949292:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a9b7054000, transno 4294967300 00000100:00100000:1.0:1788535900.949308:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607073920:0@lo:400:kworker.0 00000100:00100000:1.0:1788535900.949329:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607073408:0@lo:400:kworker.0 00000100:00100000:0.0:1788535900.962201:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788535901.044241:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535901.044298:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535901.044342:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535901.044392:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535901.044436:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589214848 00000100:00100000:1.0:1788535901.044448:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589214848 00000100:00100000:1.0:1788535901.044524:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1788535901.044538:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2356:x1875415589214848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535901.044666:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589214720 00000100:00100000:2.0:1788535901.044670:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589214720 00000100:00100000:2.0:1788535901.044719:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589214976 00000100:00100000:2.0:1788535901.044723:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589214976 00000100:00100000:2.0:1788535901.044747:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:2.0:1788535901.044767:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2356:x1875415589214720:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535901.044861:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2356:x1875415589214720:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 96us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535901.044870:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:2.0:1788535901.044922:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:2.0:1788535901.044929:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589214976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535901.044956:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589214976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535901.044984:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1788535901.045162:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2356:x1875415589214848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 627us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535901.045170:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:0.0:1788535901.045253:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589214592 00000100:00100000:0.0:1788535901.045259:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589214592 00000100:00100000:0.0:1788535901.045299:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 270 00000100:00100000:0.0:1788535901.045306:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2356:x1875415589214592:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535901.045336:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2356:x1875415589214592:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535901.045342:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 270 00000100:00080000:3.0:1788535901.045467:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788535901.045474:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788535901.069578:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535901.453460:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535901.453508:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607074048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535901.453613:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535901.453837:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607074048 00000100:00100000:2.0:1788535901.453848:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607074048 00000100:00100000:2.0:1788535901.463013:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788535901.463050:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607074048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535901.463111:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788535901.463239:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607074048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 211us (9625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535901.463248:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788535901.468128:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607074048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788535902.093081:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535902.480141:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607074176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535902.480230:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535902.480345:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607074176 00000100:00100000:1.0:1788535902.480353:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607074176 00000100:00100000:1.0:1788535902.480416:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788535902.480427:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607074176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535902.480468:0:10342:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535902.480521:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607074176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535902.480529:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788535902.480555:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788535902.480587:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d05c00 x1875415607074176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535902.480608:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607074176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788535903.117138:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788535904.013806:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788535904.141429:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535905.165477:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535906.061974:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607074432:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.062046:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.062113:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607074944:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.062140:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.062170:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788535906.062176:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607074304:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.062206:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.062224:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607074816:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.062245:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.062292:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607074432 00000100:00100000:0.0:1788535906.062299:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607074432 00000100:00100000:0.0:1788535906.062337:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607074816 00000100:00100000:0.0:1788535906.062340:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607074816 00000100:00100000:0.0:1788535906.062363:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788535906.062371:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607074432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.062419:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607074432:12345-0@lo:400:kworker.0 Request processed in 49us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.062440:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788535906.062456:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788535906.062461:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875415607074816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.062486:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875415607074816:12345-0@lo:400:kworker.0 Request processed in 25us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.062491:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788535906.062527:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607074816:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.062540:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607074432:0@lo:400:kworker.0 00000100:00100000:3.0:1788535906.062925:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607074944 00000100:00100000:3.0:1788535906.062931:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607074944 00000100:00100000:3.0:1788535906.062988:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788535906.062996:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607074944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535906.063035:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607074944:12345-0@lo:400:kworker.0 Request processed in 40us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535906.063040:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788535906.063165:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607074944:0@lo:400:kworker.0 00000100:00100000:1.0:1788535906.063368:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607074560:0@lo:400:kworker.0 00000100:00100000:1.0:1788535906.063404:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535906.063435:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788535906.063441:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607074688:0@lo:400:kworker.0 00000100:00100000:1.0:1788535906.063464:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535906.063502:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607074304 00000100:00100000:1.0:1788535906.063506:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607074304 00000100:00100000:1.0:1788535906.063542:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788535906.063549:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3309:x1875415607074304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535906.063593:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3309:x1875415607074304:12345-0@lo:400:kworker.0 Request processed in 46us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535906.063599:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:1.0:1788535906.063648:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535906.063653:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535906.063818:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607074688 00000100:00100000:2.0:1788535906.063823:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607074688 00000100:00100000:2.0:1788535906.063864:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788535906.063871:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607074688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535906.063937:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607074688:12345-0@lo:400:kworker.0 Request processed in 66us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535906.063943:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788535906.064088:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607074560 00000100:00100000:3.0:1788535906.064099:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607074560 00000100:00100000:3.0:1788535906.064139:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788535906.064147:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607074560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535906.064179:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607074560:12345-0@lo:400:kworker.0 Request processed in 34us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535906.064185:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788535906.066515:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607074304:0@lo:400:kworker.0 00000100:00080000:1.0:1788535906.066642:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788535906.066651:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788535906.066697:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b7055500 x1875415607074688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535906.066711:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607074688:0@lo:400:kworker.0 00000100:00100000:1.0:1788535906.066728:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607074560:0@lo:400:kworker.0 00000100:00100000:2.0:1788535906.165085:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535906.165132:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535906.165292:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589215232 00000100:00100000:3.0:1788535906.165301:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589215232 00000100:00100000:3.0:1788535906.165388:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:3.0:1788535906.165409:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2357:x1875415589215232:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535906.165489:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2357:x1875415589215232:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 73us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535906.165498:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:1.0:1788535906.165738:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589215104 00000100:00100000:1.0:1788535906.165744:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589215104 00000100:00100000:1.0:1788535906.165784:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 272 00000100:00100000:1.0:1788535906.165792:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2357:x1875415589215104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535906.165824:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2357:x1875415589215104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535906.165831:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 272 00000100:00080000:2.0:1788535906.165910:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535906.178743:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535906.178808:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535906.178940:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589215360 00000100:00100000:3.0:1788535906.178949:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589215360 00000100:00100000:3.0:1788535906.179042:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1788535906.179052:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+5:2354:x1875415589215360:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:3.0:1788535906.179084:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3b23 00000100:00080000:3.0:1788535906.179092:0:8424:0:(import.c:65:import_set_state_nolock()) ffff97a9bf1ef000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788535906.179129:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1788535906.179686:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535906.180298:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+2:2354:x1875415589215360:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 718us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535906.180310:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788535906.180688:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589215488 00000100:00100000:2.0:1788535906.180696:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589215488 00000100:00100000:2.0:1788535906.180749:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:2.0:1788535906.180758:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589215488:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535906.180834:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589215488:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535906.180842:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00080000:1.0:1788535906.181604:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788535906.181610:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788535906.189107:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535906.574727:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607075072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535906.574797:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.575038:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607075072 00000100:00100000:0.0:1788535906.575047:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607075072 00000100:00100000:0.0:1788535906.575100:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788535906.575109:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607075072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535906.575144:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535906.575194:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607075072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.575201:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788535906.575388:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607075072:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788535907.155849:0:7609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 30a1922d-0d3f-4681-a966-cec3672631c6 00000020:00000080:0.0:1788535907.155857:0:7609:0:(genops.c:885:class_export_put()) final put ffff97a9bf1eb000/30a1922d-0d3f-4681-a966-cec3672631c6 00000020:00000080:1.0:1788535907.155969:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bf1eb000/30a1922d-0d3f-4681-a966-cec3672631c6 for lustre-OST0001 00000020:00000080:1.0:1788535907.156025:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9bf1ef000 for lustre-OST0001 00010000:00010000:1.0:1788535907.213041:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535907.597087:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788535907.597109:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607075200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535907.597177:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535907.597326:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607075200 00000100:00100000:0.0:1788535907.597335:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607075200 00000100:00100000:0.0:1788535907.597382:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788535907.597392:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607075200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788535907.597425:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535907.597467:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607075200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535907.597474:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788535907.598471:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d05c00 x1875415607075200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535907.600956:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607075200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788535908.242804:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535909.261914:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535910.286057:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535911.183040:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607075712:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.183115:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535911.183190:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535911.183212:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607075584:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.183241:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535911.183335:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607075328:0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.183370:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535911.183407:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607075840:0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.183431:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535911.183449:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788535911.183455:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607075456:0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.183477:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535911.183495:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607075968:0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.183514:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535911.183542:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607075584 00000100:00100000:2.0:1788535911.183549:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607075584 00000100:00100000:2.0:1788535911.183601:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607075840 00000100:00100000:2.0:1788535911.183604:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607075840 00000100:00100000:2.0:1788535911.183621:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607075456 00000100:00100000:2.0:1788535911.183623:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607075456 00000100:00100000:2.0:1788535911.183648:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788535911.183656:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607075584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.183706:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607075584:12345-0@lo:400:kworker.0 Request processed in 51us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535911.183720:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788535911.183737:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788535911.183743:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607075840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.183778:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607075840:12345-0@lo:400:kworker.0 Request processed in 35us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535911.183783:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788535911.183793:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788535911.183798:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607075456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.183822:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607075456:12345-0@lo:400:kworker.0 Request processed in 24us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535911.183827:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1788535911.183845:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535911.183875:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607075456:0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.183884:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607075840:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.184099:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607075328 00000100:00100000:3.0:1788535911.184104:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607075328 00000100:00100000:3.0:1788535911.184149:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788535911.184157:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607075328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.184194:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607075328:12345-0@lo:400:kworker.0 Request processed in 39us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535911.184200:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788535911.184231:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607075712 00000100:00100000:3.0:1788535911.184235:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607075712 00000100:00100000:3.0:1788535911.184262:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607075968 00000100:00100000:3.0:1788535911.184266:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607075968 00000100:00100000:3.0:1788535911.184287:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788535911.184293:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607075712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.184323:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607075712:12345-0@lo:400:kworker.0 Request processed in 31us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535911.184330:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788535911.184341:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788535911.184348:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607075968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.184375:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607075968:12345-0@lo:400:kworker.0 Request processed in 28us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535911.184380:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788535911.184399:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535911.184403:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535911.184422:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607075584:0@lo:400:kworker.0 00010000:00080000:3.0:1788535911.184435:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9c0814000 x1875415607075712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535911.184453:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607075712:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.184480:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607075968:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.184488:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607075328:0@lo:400:kworker.0 00000100:00100000:0.0:1788535911.283371:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535911.283417:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535911.283453:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535911.284077:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589215616 00000100:00100000:1.0:1788535911.284089:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589215616 00000100:00100000:1.0:1788535911.284161:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 274 00000100:00100000:1.0:1788535911.284171:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2355:x1875415589215616:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535911.284257:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2355:x1875415589215616:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 87us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535911.284265:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 274 00000100:00100000:3.0:1788535911.287255:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589215872 00000100:00100000:3.0:1788535911.287269:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589215872 00000100:00100000:3.0:1788535911.287397:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589215744 00000100:00100000:3.0:1788535911.287401:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589215744 00000100:00100000:1.0:1788535911.287451:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:1.0:1788535911.287464:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2355:x1875415589215872:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535911.287547:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2355:x1875415589215872:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 87us (4129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535911.287555:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00080000:0.0:1788535911.292463:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535911.293277:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:3.0:1788535911.293293:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+5:2355:x1875415589215744:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535911.293404:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+5:2355:x1875415589215744:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 115us (9949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535911.293413:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 110 00010000:00010000:0.0:1788535911.312361:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535911.693217:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607076096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535911.693300:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535911.693720:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607076096 00000100:00100000:1.0:1788535911.693729:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607076096 00000100:00100000:1.0:1788535911.693786:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788535911.693795:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607076096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535911.693829:0:10342:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535911.694060:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607076096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 263us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535911.694068:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788535911.695091:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607076096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788535912.333602:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535912.717221:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607076224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535912.717299:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535912.720026:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607076224 00000100:00100000:1.0:1788535912.720039:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607076224 00000100:00100000:1.0:1788535912.720106:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788535912.720115:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607076224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535912.720151:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535912.722353:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607076224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2231us (5045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535912.722366:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788535912.724670:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b8d05c00 x1875415607076224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535912.724703:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607076224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788535913.357171:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788535914.255532:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788535914.384011:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788535915.388390:0:11809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 11:31:54 (1788535914) 00010000:00010000:0.0:1788535915.409689:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535916.301874:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607076480:0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.301971:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607076352:0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.301979:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535916.302019:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535916.302037:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607076992:0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.302068:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607076864:0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.302099:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535916.302102:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535916.302148:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607076608:0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.302153:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607076352 00000100:00100000:3.0:1788535916.302162:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607076352 00000100:00100000:1.0:1788535916.302175:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535916.302194:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788535916.302199:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607076736:0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.302213:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788535916.302223:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535916.302236:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607076352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.302252:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607076480 00000100:00100000:1.0:1788535916.302256:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607076480 00000100:00100000:3.0:1788535916.302290:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607076352:12345-0@lo:400:kworker.0 Request processed in 59us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535916.302298:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788535916.302329:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607076992 00000100:00100000:3.0:1788535916.302333:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607076992 00000100:00100000:3.0:1788535916.302360:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607076736 00000100:00100000:3.0:1788535916.302363:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607076736 00000100:00100000:3.0:1788535916.302382:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788535916.302389:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607076992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.302424:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607076992:12345-0@lo:400:kworker.0 Request processed in 36us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535916.302430:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788535916.302442:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788535916.302450:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607076736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535916.302476:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607076864 00000100:00100000:2.0:1788535916.302481:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607076864 00000100:00100000:3.0:1788535916.302486:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607076736:12345-0@lo:400:kworker.0 Request processed in 37us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535916.302493:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788535916.302510:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607076608 00000100:00100000:2.0:1788535916.302513:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607076608 00000100:00100000:2.0:1788535916.302539:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788535916.302543:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607076352:0@lo:400:kworker.0 00000100:00100000:2.0:1788535916.302549:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607076864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535916.302595:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607076864:12345-0@lo:400:kworker.0 Request processed in 49us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535916.302607:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788535916.302622:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607076608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535916.302627:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788535916.302665:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607076608:12345-0@lo:400:kworker.0 Request processed in 48us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535916.302666:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607076864:0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.302679:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788535916.302735:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607076992:0@lo:400:kworker.0 00010000:00080000:2.0:1788535916.302766:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a986f17b80 x1875415607076736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535916.302776:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607076736:0@lo:400:kworker.0 00000100:00100000:2.0:1788535916.302801:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607076608:0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.302925:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788535916.302933:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607076480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.302978:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607076480:12345-0@lo:400:kworker.0 Request processed in 46us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535916.302983:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1788535916.303058:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788535916.303063:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788535916.303065:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535916.304175:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607076480:0@lo:400:kworker.0 00000100:00100000:0.0:1788535916.408980:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535916.409029:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535916.409075:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535916.409122:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589216256 00000100:00100000:0.0:1788535916.409131:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589216256 00000100:00100000:0.0:1788535916.409184:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589216128 00000100:00100000:0.0:1788535916.409187:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589216128 00000100:00100000:2.0:1788535916.409198:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:2.0:1788535916.409211:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589216256:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535916.409253:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589216000 00000100:00100000:1.0:1788535916.409259:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589216000 00000100:00100000:1.0:1788535916.409290:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 276 00000100:00100000:2.0:1788535916.409298:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589216256:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 88us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535916.409301:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2358:x1875415589216000:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535916.409339:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2358:x1875415589216000:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535916.409347:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 276 00000100:00080000:1.0:1788535916.409489:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535916.409623:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:0.0:1788535916.409632:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589216128:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535916.409677:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589216128:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 46us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535916.409684:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:2.0:1788535916.416959:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00010000:00010000:3.0:1788535916.433293:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535916.813251:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607077120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535916.813327:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535916.813477:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607077120 00000100:00100000:2.0:1788535916.813485:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607077120 00000100:00100000:2.0:1788535916.813534:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788535916.813543:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607077120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535916.813585:0:10342:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788535916.813641:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607077120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535916.813648:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788535916.813676:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607077120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535916.860100:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535916.860180:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589216384 00000100:00100000:2.0:1788535916.860191:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589216384 00000100:00100000:2.0:1788535916.860258:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:2.0:1788535916.860282:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+5:10226:x1875415589216384:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535916.860302:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535916.860325:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3bee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515659 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.860388:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3bf5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.860401:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.860427:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535916.860462:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788535916.860465:0:6697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788535916.860501:0:6697:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.860524:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3bee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515659 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.860541:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515659 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.860549:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a99742ae00) 00010000:00010000:2.0:1788535916.860552:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788535916.860555:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747f000, rc 0) 00000100:00100000:2.0:1788535916.860639:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:10226:x1875415589216384:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 359us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535916.860656:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1788535916.875401:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535916.875504:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589216512 00000100:00100000:1.0:1788535916.875514:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589216512 00000100:00100000:1.0:1788535916.875585:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1788535916.875605:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:10227:x1875415589216512:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788535916.875627:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535916.875650:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3bfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515660 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.875725:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d3c03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.875740:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d3c03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.875753:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d3c03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.875768:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3c0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.875776:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3c0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.875782:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3c0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876051:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3c11 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876061:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3c11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876420:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3c11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535916.876447:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788535916.876451:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535916.876470:0:5834:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3c11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876481:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d3c03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876488:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d3c03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876494:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d3c03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876499:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0be00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535916.876503:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d3c03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876510:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d3c03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876520:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a99742ae00) 00010000:00010000:1.0:1788535916.876524:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535916.876528:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d3c03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876534:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d3c03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876713:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3c0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876721:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3c0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876728:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3c0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876732:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535916.876736:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3c0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876742:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3c0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876750:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97a9888ad600) 00010000:00010000:1.0:1788535916.876752:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535916.876755:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3c0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876760:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3c0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876795:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3bfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515660 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876808:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3c11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515660 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535916.876826:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a9888ade00) 00010000:00010000:1.0:1788535916.876828:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535916.876830:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0b600, rc 0) 00000100:00100000:1.0:1788535916.877264:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+7:10227:x1875415589216512:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1668us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535916.877273:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:3.0:1788535916.891192:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535916.891266:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589216768 00000100:00100000:2.0:1788535916.891276:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589216768 00000100:00100000:2.0:1788535916.891337:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:2.0:1788535916.891348:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+7:10227:x1875415589216768:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535916.891366:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535916.891384:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3c18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515667 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.891446:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3c1f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.891461:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3c1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.891471:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3c1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.891483:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3c26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.891490:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3c26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.891495:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3c26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.892404:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fa00/0x74f51638375d3c2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.892430:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fa00/0x74f51638375d3c2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.892439:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fa00/0x74f51638375d3c2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535916.892450:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788535916.892590:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3c1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.893728:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3c1f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.893737:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3c1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.893743:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535916.893747:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3c1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.893755:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3c1f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.893769:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a9888ade00) 00010000:00010000:2.0:1788535916.893772:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535916.893777:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3c1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.893782:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3c1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.893799:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3c26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.893817:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3c26 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.893822:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3c26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.893827:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ee00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535916.894177:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3c26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.894187:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3c26 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.894196:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97a99742a000) 00010000:00010000:2.0:1788535916.894199:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535916.894203:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3c26 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.894209:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3c26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.894758:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3c18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515667 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.894775:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fa00/0x74f51638375d3c2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515667 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535916.894783:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a99742a400) 00010000:00010000:2.0:1788535916.894786:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535916.894795:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747fa00, rc 0) 00000100:00100000:2.0:1788535916.894883:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+9:10227:x1875415589216768:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 3536us (3699us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788535916.894930:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1788535916.903229:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535916.903321:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589216896 00000100:00100000:1.0:1788535916.903331:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589216896 00000100:00100000:1.0:1788535916.903392:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1788535916.903403:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+9:10227:x1875415589216896:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788535916.903499:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+9:10227:x1875415589216896:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 98us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535916.903507:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000040:00080000:2.0:1788535917.336214:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:3.0:1788535917.415446:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1788535917.458128:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535917.838761:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535917.838782:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a984eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607077248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535917.838843:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535917.838881:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607077248 00000100:00100000:1.0:1788535917.838906:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607077248 00000100:00100000:1.0:1788535917.838961:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788535917.838970:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607077248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535917.839002:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535917.839049:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607077248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535917.839056:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788535917.839109:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a984eb1500 x1875415607077248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535917.839128:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a984eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607077248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788535918.477058:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535919.102992:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535919.103461:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589217024 00000100:00100000:1.0:1788535919.103472:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589217024 00000100:00100000:1.0:1788535919.103542:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:1.0:1788535919.103555:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+8:10270:x1875415589217024:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788535919.103576:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535919.103607:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3c3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751566e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.103671:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3c42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.103686:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3c42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.103699:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3c42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.103714:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3c49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.103721:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3c49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.103728:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3c49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104144:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3c42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104155:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3c42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104173:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3c42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104179:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535919.104184:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3c42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104191:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3c42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104204:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a99742ae00) 00010000:00010000:1.0:1788535919.104207:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535919.104211:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3c42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104217:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3c42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104228:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3c49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104356:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3c49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104364:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3c49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104369:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535919.104372:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3c49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104386:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3c49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104395:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97a9888ad600) 00010000:00010000:1.0:1788535919.104398:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535919.104401:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3c49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104407:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3c49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104441:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3c3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751566e expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104452:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a99742ae00) 00010000:00010000:1.0:1788535919.104454:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535919.104459:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d3c3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751566e expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.104468:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0bc00, rc 0) 00000100:00080000:2.0:1788535919.104611:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535919.104720:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+8:10270:x1875415589217024:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1167us (1735us total) trans 0 rc 301/301 00000100:00100000:1.0:1788535919.104728:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:1.0:1788535919.119974:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535919.120049:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589217280 00000100:00100000:3.0:1788535919.120069:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589217280 00000100:00100000:3.0:1788535919.120131:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:3.0:1788535919.120142:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+8:10270:x1875415589217280:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:3.0:1788535919.120195:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535919.120222:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3bf5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515659 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.120241:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a99742ae00) 00010000:00010000:3.0:1788535919.120370:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535919.120596:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c50 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.120611:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.120621:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.120634:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3c57 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.120649:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3c57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.120656:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3c57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535919.121875:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788535919.121924:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.121933:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c50 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.121939:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c50 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.121945:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4ac00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535919.121950:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c50 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.121958:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c50 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.121970:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a997503300) 00010000:00010000:3.0:1788535919.121973:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535919.121977:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c50 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.121983:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c50 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535919.122014:0:5832:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000a391cdbb reply state 000000005d120fb5 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3c57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535919.122023:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535919.122144:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+9:10270:x1875415589217280:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 2001us (2176us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788535919.122153:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00010000:00010000:3.0:1788535919.125780:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3c57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.125798:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3c57 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.125805:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3c57 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.125811:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535919.125815:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3c57 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.125823:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3c57 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.125839:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97a997503700) 00010000:00010000:3.0:1788535919.125842:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535919.125846:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3c57 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.125852:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3c57 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535919.232064:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535919.232253:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589217408 00000100:00100000:0.0:1788535919.232262:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589217408 00000100:00100000:0.0:1788535919.232319:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788535919.232330:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:10278:x1875415589217408:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:0.0:1788535919.232352:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535919.232374:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3c5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515675 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.232432:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050000/0x74f51638375d3c65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.232444:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050000/0x74f51638375d3c65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.232455:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050000/0x74f51638375d3c65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535919.232501:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788535919.232504:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535919.232536:0:5833:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050000/0x74f51638375d3c65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.232557:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3c5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515675 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.232575:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050000/0x74f51638375d3c65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515675 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.232599:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9a0685800) 00010000:00010000:0.0:1788535919.232602:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788535919.232606:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c2050000, rc 0) 00000100:00100000:0.0:1788535919.232721:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+9:10278:x1875415589217408:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 392us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535919.232737:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:3.0:1788535919.314376:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535919.314486:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589217536 00000100:00100000:1.0:1788535919.314496:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589217536 00000100:00100000:1.0:1788535919.314561:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788535919.314594:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+9:10284:x1875415589217536:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788535919.314622:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535919.314642:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3c6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751567c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.314704:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3c73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.314718:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3c73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.314738:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3c73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.314754:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3c7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.314761:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3c7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.314767:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3c7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.314868:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3c81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.314876:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3c81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.314882:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3c81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535919.314959:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788535919.314962:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535919.314999:0:5834:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3c81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315012:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3c73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315019:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3c73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315025:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3c73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315031:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535919.315035:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3c73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315043:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3c73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315054:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9a0685800) 00010000:00010000:1.0:1788535919.315057:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535919.315062:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3c73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315068:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3c73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315081:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3c7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315097:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3c7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315103:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3c7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315108:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ac00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535919.315112:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3c7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315118:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3c7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315126:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97a9888ad600) 00010000:00010000:1.0:1788535919.315129:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535919.315131:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3c7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315137:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3c7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315164:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3c6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751567c expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315177:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3c81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751567c expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.315183:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:1.0:1788535919.315185:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788535919.315193:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0b000, rc 0) 00000100:00100000:1.0:1788535919.315244:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+10:10284:x1875415589217536:12345-192.168.203.12@tcp:101:bash.0 Request processed in 654us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535919.315251:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788535919.317627:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535919.317709:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589217792 00000100:00100000:3.0:1788535919.317718:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589217792 00000100:00100000:3.0:1788535919.317826:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:3.0:1788535919.317838:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+10:10284:x1875415589217792:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788535919.317856:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535919.317875:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3c88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515683 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.318035:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.318310:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.318325:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.318342:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3c96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.318351:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3c96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.318358:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3c96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788535919.318938:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788535919.319112:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d3c9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.319127:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d3c9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.319134:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d3c9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.319178:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.319185:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c8f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.319192:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.319197:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4ac00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535919.319201:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.319207:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.319218:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:3.0:1788535919.319221:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535919.319225:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.319232:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3c8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535919.319244:0:5832:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000008ffd28de reply state 000000005a78c06a transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3c96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535919.319256:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788535919.319284:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3c88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515683 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.319295:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d3c9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515683 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.319302:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503300) 00010000:00010000:3.0:1788535919.319304:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535919.319307:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4bc00, rc 0) 00000100:00100000:3.0:1788535919.319380:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+13:10284:x1875415589217792:12345-192.168.203.12@tcp:101:bash.0 Request processed in 1545us (1769us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788535919.319387:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788535919.324553:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1788535919.325191:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3c96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.325205:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3c96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.325213:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3c96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.325219:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535919.325224:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3c96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.325232:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3c96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.325269:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a997503700) 00010000:00010000:3.0:1788535919.325273:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535919.325278:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3c96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.325285:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3c96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535919.325368:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589217920 00000100:00100000:1.0:1788535919.325378:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589217920 00000100:00100000:1.0:1788535919.325425:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788535919.325433:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875415589217920:12345-192.168.203.12@tcp:8:bash.0 00010000:00080000:1.0:1788535919.325463:0:6673:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:1.0:1788535919.325491:0:6673:0:(genops.c:1385:class_connect()) connect: client 30a1922d-0d3f-4681-a966-cec3672631c6, cookie 0x74f51638375d3cab 00002000:00100000:1.0:1788535919.325503:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 30a1922d-0d3f-4681-a966-cec3672631c6/ffff97a9b6d7b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788535919.325524:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788535919.326266:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788535919.326300:0:6673:0:(import.c:65:import_set_state_nolock()) ffff97a9b6d7d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788535919.326375:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+6:2354:x1875415589217920:12345-192.168.203.12@tcp:8:bash.0 Request processed in 941us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535919.326384:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788535919.331663:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535919.338654:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589218048 00000100:00100000:0.0:1788535919.338669:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589218048 00000100:00100000:0.0:1788535919.338763:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788535919.338775:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:0:x1875415589218048:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788535919.338793:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535919.338818:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000396c8c01/0x74f51638375d3cb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751568a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535919.338845:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00080000:2.0:1788535919.338926:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788535919.339234:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788535919.339239:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535919.339250:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000396c8c01/0x74f51638375d3cb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751568a expref: 7 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.339272:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000396c8c01/0x74f51638375d3cb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751568a expref: 7 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.339286:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c2051800, rc 0) 00000100:00100000:0.0:1788535919.339342:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+7:0:x1875415589218048:12345-192.168.203.12@tcp:101:bash.0 Request processed in 571us (7689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535919.339350:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1788535919.346693:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535919.346779:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589218176 00000100:00100000:3.0:1788535919.346798:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589218176 00000100:00100000:3.0:1788535919.346859:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788535919.346871:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+7:10284:x1875415589218176:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788535919.346924:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535919.346945:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515691 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.346974:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000396c8c01/0x74f51638375d3cb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751568a expref: 8 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.346984:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535919.346988:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535919.346994:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.347041:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000396c8c01/0x74f51638375d3cb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751568a expref: 8 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.347075:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000396c8c01/0x74f51638375d3cb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751568a expref: 8 pid: 6674 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535919.347090:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8424:1875415607077376:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535919.347169:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b668bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535919.351326:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535919.351367:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589218304 00000100:00100000:2.0:1788535919.351377:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589218304 00010000:00010000:2.0:1788535919.351413:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000396c8c01/0x74f51638375d3cb2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751568a expref: 9 pid: 6674 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535919.351450:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:2.0:1788535919.351459:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+9:2356:x1875415589218304:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535919.351474:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535919.351496:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000396c8c01/0x74f51638375d3cb2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751568a expref: 9 pid: 6674 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535919.351510:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000396c8c01/0x74f51638375d3cb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751568a expref: 9 pid: 6674 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535919.351538:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535919.351543:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535919.351564:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535919.351575:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535919.351629:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535919.351644:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f14700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1875415607077504:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788535919.351724:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988780d80 going to sleep for 11 seconds 00010000:00010000:0.0:1788535919.355116:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000396c8c01/0x74f51638375d3cb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751568a expref: 9 pid: 6674 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535919.355150:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8424:1875415607077376:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535919.355183:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.355197:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b800, rc 0) 00000100:00100000:0.0:1788535919.355274:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+8:10284:x1875415589218176:12345-192.168.203.12@tcp:101:bash.0 Request processed in 8406us (8588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535919.355282:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1788535919.357851:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f14700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1875415607077504:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788535919.357877:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535919.357959:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+7:2356:x1875415589218304:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 6500us (6644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535919.357970:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:2.0:1788535919.359322:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535919.359403:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589218560 00000100:00100000:0.0:1788535919.359412:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589218560 00000100:00100000:0.0:1788535919.359461:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1788535919.359487:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+12:10284:x1875415589218560:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:0.0:1788535919.360180:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+13:10284:x1875415589218560:12345-192.168.203.12@tcp:35:bash.0 Request processed in 692us (860us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788535919.360189:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000001:00100000:1.0:1788535919.459881:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 30a1922d-0d3f-4681-a966-cec3672631c6 00000100:00100000:2.0:1788535919.467863:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535919.468000:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589218816 00000100:00100000:3.0:1788535919.468010:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589218816 00000100:00100000:3.0:1788535919.468079:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:3.0:1788535919.468089:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+13:10295:x1875415589218816:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535919.468111:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535919.468131:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3cc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515698 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535919.468218:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788535919.468338:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3cc0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515698 expref: 15 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.468353:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9a0685800) 00010000:00010000:3.0:1788535919.468356:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535919.468361:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3cc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515698 expref: 15 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.468374:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b600, rc 0) 00000100:00100000:3.0:1788535919.468592:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+14:10295:x1875415589218816:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 503us (735us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788535919.468615:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:3.0:1788535919.472013:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535919.472086:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589219072 00000100:00100000:0.0:1788535919.472096:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589219072 00000100:00100000:0.0:1788535919.472153:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788535919.472162:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+14:10295:x1875415589219072:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788535919.474195:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+15:10295:x1875415589219072:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 2023us (2181us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788535919.474208:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00010000:00010000:3.0:1788535919.501764:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535919.566054:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535919.566192:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589219200 00000100:00100000:1.0:1788535919.566208:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589219200 00000100:00100000:1.0:1788535919.566265:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1788535919.566276:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+15:10302:x1875415589219200:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788535919.566299:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535919.566318:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3cce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751569f expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.566378:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3cd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.566393:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.566405:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535919.566437:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788535919.566440:0:11644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535919.566459:0:11644:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.566494:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3cce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751569f expref: 17 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.566512:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751569f expref: 16 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.566521:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:1.0:1788535919.566524:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535919.566527:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a800, rc 0) 00000100:00100000:1.0:1788535919.566602:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+16:10302:x1875415589219200:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 327us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535919.566608:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1788535919.572412:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535919.572484:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589219456 00000100:00100000:3.0:1788535919.572494:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589219456 00000100:00100000:3.0:1788535919.572553:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788535919.572563:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+16:10302:x1875415589219456:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535919.572591:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535919.572609:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3cdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975156a6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.572708:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3ce3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.572722:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.572734:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535919.572745:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788535919.572861:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3cdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156a6 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.572879:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156a6 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.572949:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503300) 00010000:00010000:3.0:1788535919.572953:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535919.572956:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4ac00, rc 0) 00000100:00100000:3.0:1788535919.573012:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+18:10302:x1875415589219456:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 450us (608us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788535919.573020:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1788535919.575941:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535919.576001:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589219584 00000100:00100000:1.0:1788535919.576011:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589219584 00000100:00100000:1.0:1788535919.576079:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:1.0:1788535919.576090:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+18:2358:x1875415589219584:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535919.576103:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535919.576127:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d3ce3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156a6 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.576145:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503300) 00010000:00010000:1.0:1788535919.576149:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535919.576201:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+17:2358:x1875415589219584:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 113us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535919.576209:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:1.0:1788535919.578936:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535919.579415:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589219840 00000100:00100000:0.0:1788535919.579425:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589219840 00000100:00100000:0.0:1788535919.579483:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:0.0:1788535919.579493:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+17:10302:x1875415589219840:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535919.579516:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535919.579536:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2051800/0x74f51638375d3cf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975156ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.579641:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3cf8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.579657:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.579669:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535919.579700:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788535919.579830:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2051800/0x74f51638375d3cf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156ad expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.579848:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156ad expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.579857:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503300) 00010000:00010000:0.0:1788535919.579859:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788535919.579863:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c2050600, rc 0) 00000100:00100000:0.0:1788535919.580144:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+19:10302:x1875415589219840:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 651us (1214us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788535919.580153:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:3.0:1788535919.588601:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535919.588686:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589219968 00000100:00100000:1.0:1788535919.588695:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589219968 00000100:00100000:1.0:1788535919.588762:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1788535919.588772:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589219968:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:1.0:1788535919.588813:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.588834:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 6 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.588870:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535919.588874:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535919.588879:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.588945:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 6 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.588958:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 6 pid: 8424 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535919.588973:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a984eb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1875415607077632:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788535919.589230:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535919.591484:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a984eb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1875415607077632:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535919.591515:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535919.592226:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535919.592318:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589220096 00000100:00100000:0.0:1788535919.592325:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589220096 00002000:00100000:0.0:1788535919.592369:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff97a9b61a0380 x1875415589220096/t0(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:575/0 lens 504/0 e 0 to 0 dl 1788535930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535919.592380:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b61a0380 with x1875415589220096 ext(0->12) 00010000:00010000:0.0:1788535919.592388:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 7 pid: 8424 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.592404:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 7 pid: 8424 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535919.592412:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97a9b61a0380 00000100:00100000:0.0:1788535919.592445:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788535919.592467:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:30a1922d-0d3f-4681-a966-cec3672631c6+7:2356:x1875415589220096:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:0.0:1788535919.593178:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:30a1922d-0d3f-4681-a966-cec3672631c6+9:2356:x1875415589220096:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 709us (953us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788535919.593187:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00100000:0.0:1788535919.593195:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff97a9b61a0380 x1875415589220096/t4294967299(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:575/0 lens 504/448 e 0 to 0 dl 1788535930 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535919.593203:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b61a0380 with x1875415589220096 ext(0->12) 00010000:00010000:0.0:1788535919.593209:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 9 pid: 8424 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.593223:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 9 pid: 8424 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535919.593230:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97a9b61a0380 00000100:00100000:2.0:1788535919.595546:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535919.595684:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589220224 00000100:00100000:3.0:1788535919.595693:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589220224 00010000:00010000:3.0:1788535919.595736:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 9 pid: 8424 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535919.595772:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1788535919.595780:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+9:2356:x1875415589220224:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535919.595793:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788535919.595813:0:7598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788535919.595816:0:7598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788535919 00002000:00010000:3.0:1788535919.595818:0:7598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788535919 00002000:00010000:3.0:1788535919.595820:0:7598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788535919 00010000:00010000:3.0:1788535919.595826:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 9 pid: 8424 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.595840:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 9 pid: 8424 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.595924:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d3cb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515691 expref: 9 pid: 8424 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.595940:0:7598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535919.595945:0:7598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535919.595951:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.595961:0:7598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.595983:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535919.596028:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+8:2356:x1875415589220224:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 249us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535919.596035:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00010000:00010000:0.0:1788535919.596657:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.596669:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.596696:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.596704:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.596735:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.596742:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ac00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788535919.596746:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.596754:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.596766:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.596774:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4214f4/0x74f51638375d3d06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535919.596836:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+7:2356:x1875415589219968:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 8064us (8244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535919.596843:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1788535919.599384:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535919.599482:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589220480 00000100:00100000:1.0:1788535919.599492:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589220480 00000100:00100000:1.0:1788535919.599549:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1788535919.599559:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+19:10302:x1875415589220480:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:1.0:1788535919.599627:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156ad expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788535919.600036:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788535919.600101:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788535919.600600:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788535919.600660:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.600675:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d3c9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515683 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.600684:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.600714:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d3c9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515683 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.601382:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d3c9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515683 expref: 23 pid: 5832 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535919.601400:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a984eb2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875415607077760:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788535919.601483:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535919.604189:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535919.604291:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a984eb2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875415607077760:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535919.604319:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535919.604390:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589220608 00000100:00100000:2.0:1788535919.604397:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589220608 00010000:00010000:2.0:1788535919.604432:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d3c9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515683 expref: 24 pid: 5832 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535919.604469:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1788535919.604477:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+24:2355:x1875415589220608:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535919.604491:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535919.604497:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d3c9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515683 expref: 24 pid: 5832 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535919.604528:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d3c9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515683 expref: 24 pid: 5832 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535919.604547:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d3c9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515683 expref: 24 pid: 5832 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535919.604561:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503300) 00010000:00010000:2.0:1788535919.604566:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535919.604585:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535919.604593:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535919.604620:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535919.604672:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+23:2355:x1875415589220608:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 195us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535919.604680:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00010000:00010000:1.0:1788535919.605321:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.605331:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788535919.605465:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788535919.605685:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788535919.605793:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a984eb0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607077888:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788535919.605921:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535919.605946:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535919.606321:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607077888 00000100:00100000:2.0:1788535919.606328:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607077888 00000100:00100000:2.0:1788535919.606388:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788535919.606395:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875415607077888:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788535919.606464:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875415607077888:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 69us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535919.606471:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788535919.606604:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a984eb0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607077888:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788535919.607282:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788535919.607346:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607078016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788535919.607387:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788535919.607485:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535919.607592:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535919.608568:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607078016 00000100:00100000:3.0:1788535919.608589:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607078016 00000100:00100000:3.0:1788535919.608678:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788535919.608688:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b737b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875415607078016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788535919.609076:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b737b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875415607078016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 390us (1687us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788535919.609084:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788535919.609188:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0815500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607078016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788535919.609252:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788535919.609291:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.609301:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.609309:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.609314:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0aa00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535919.609318:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.609325:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.609339:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503300) 00010000:00010000:0.0:1788535919.609341:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788535919.609346:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.609352:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d0d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788535919.609520:0:5836:0:(mdd_object.c:4338:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788535919.609760:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788535919.609770:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 321740882114ns, next at 322740880345ns, rc = 0 00000001:00080000:0.0:1788535919.609776:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788535919.609803:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503300) 00010000:00010000:0.0:1788535919.609806:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788535919.609814:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3cf8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156ad expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535919.609941:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+26:10302:x1875415589220480:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 10383us (10568us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788535919.609949:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000020:00080000:0.0:1788535919.609954:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788535919.613618:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535919.613707:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589220736 00000100:00100000:0.0:1788535919.613716:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589220736 00000100:00100000:0.0:1788535919.613853:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1788535919.613873:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+26:10302:x1875415589220736:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535919.613926:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535919.613949:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2051800/0x74f51638375d3d14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975156b4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.614007:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2051800/0x74f51638375d3d14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156b4 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.614023:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2051800/0x74f51638375d3d14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156b4 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.614042:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:0.0:1788535919.614045:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788535919.614194:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c2051800, rc 0) 00000100:00100000:0.0:1788535919.614257:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+27:10302:x1875415589220736:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 387us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535919.614265:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1788535919.617343:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535919.617462:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589220992 00000100:00100000:3.0:1788535919.617472:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589220992 00000100:00100000:3.0:1788535919.617531:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788535919.617542:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99c78bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+27:10302:x1875415589220992:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788535919.618077:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99c78bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+28:10302:x1875415589220992:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 533us (739us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788535919.618086:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788535919.727214:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535919.727411:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589221248 00000100:00100000:3.0:1788535919.727420:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589221248 00000100:00100000:3.0:1788535919.727494:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788535919.727505:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+28:10312:x1875415589221248:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535919.727528:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535919.727547:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975156bb expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535919.727648:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788535919.727768:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d1b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156bb expref: 30 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.727782:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9a0685800) 00010000:00010000:3.0:1788535919.727785:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535919.727789:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156bb expref: 30 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535919.727803:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b800, rc 0) 00000100:00100000:3.0:1788535919.727867:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+29:10312:x1875415589221248:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 364us (662us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788535919.727875:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:2.0:1788535919.731531:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535919.731635:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589221376 00000100:00100000:0.0:1788535919.731645:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589221376 00000100:00100000:0.0:1788535919.731703:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1788535919.731715:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+29:10312:x1875415589221376:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788535919.731801:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3d29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.731816:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3d29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.731828:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3d29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.731877:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.731927:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.731937:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732022:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732030:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732060:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535919.732103:0:5834:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732115:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3d29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732122:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3d29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732129:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3d29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732135:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c2050600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535919.732140:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3d29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732148:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3d29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732159:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:0.0:1788535919.732162:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535919.732167:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3d29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732174:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050600/0x74f51638375d3d29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732188:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732200:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732206:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732212:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535919.732215:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732222:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732231:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a9a0685400) 00010000:00010000:0.0:1788535919.732233:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535919.732237:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732242:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732257:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732264:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732270:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732276:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535919.732285:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732291:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732300:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:0.0:1788535919.732303:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535919.732306:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.732312:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535919.732389:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+29:10312:x1875415589221376:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 676us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535919.732397:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1788535919.736360:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535919.736456:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589221632 00000100:00100000:1.0:1788535919.736465:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589221632 00000100:00100000:1.0:1788535919.736520:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1788535919.736530:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+29:10312:x1875415589221632:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788535919.736751:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+30:10312:x1875415589221632:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 222us (402us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788535919.736759:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788535919.796091:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535919.796185:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589221888 00000100:00100000:0.0:1788535919.796195:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589221888 00000100:00100000:0.0:1788535919.796252:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:0.0:1788535919.796262:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+30:10315:x1875415589221888:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535919.796285:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535919.796304:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975156c2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796375:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796389:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796414:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796429:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3d4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796436:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796442:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796545:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d3d53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796554:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d3d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796560:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d3d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535919.796570:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788535919.796678:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796685:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796691:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796697:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535919.796706:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796713:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796723:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:0.0:1788535919.796726:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535919.796731:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796736:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3d45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796749:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796754:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3d4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796760:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3d4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796766:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecbe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535919.796768:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3d4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796774:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3d4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796780:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a9a0685400) 00010000:00010000:0.0:1788535919.796782:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535919.796792:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3d4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796797:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3d4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796835:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156c2 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796850:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d3d53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156c2 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535919.796856:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:0.0:1788535919.796858:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535919.796860:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecaa00, rc 0) 00000100:00100000:0.0:1788535919.796972:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+32:10315:x1875415589221888:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 712us (889us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788535919.796980:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1788535919.804839:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535919.804950:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589222016 00000100:00100000:1.0:1788535919.804961:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589222016 00000100:00100000:1.0:1788535919.805017:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1788535919.805027:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+32:10315:x1875415589222016:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788535919.805200:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.805215:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.805227:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.805251:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.805273:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.805279:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.805284:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0aa00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535919.805288:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.805295:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.805306:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:1.0:1788535919.805308:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788535919.805313:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535919.805318:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535919.805385:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+32:10315:x1875415589222016:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 360us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535919.805392:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1788535919.813774:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535919.816932:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589222272 00000100:00100000:1.0:1788535919.816947:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589222272 00000100:00100000:1.0:1788535919.817090:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788535919.817101:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+32:10315:x1875415589222272:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788535919.817348:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+33:10315:x1875415589222272:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 248us (3583us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788535919.817369:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1788535920.148158:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535920.148288:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589222528 00000100:00100000:3.0:1788535920.148298:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589222528 00000100:00100000:3.0:1788535920.148364:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:3.0:1788535920.148397:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+33:10346:x1875415589222528:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:3.0:1788535920.148424:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535920.148444:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975156c9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.148540:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3d6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.148555:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.148567:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535920.148633:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788535920.148774:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156c9 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.148793:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156c9 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.148801:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:3.0:1788535920.148804:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535920.148807:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b600, rc 0) 00000100:00100000:3.0:1788535920.148871:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+35:10346:x1875415589222528:12345-192.168.203.12@tcp:101:cat.0 Request processed in 484us (721us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788535920.148878:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1788535920.152582:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535920.152655:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589222656 00000100:00100000:3.0:1788535920.152665:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589222656 00000100:00100000:3.0:1788535920.152761:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:3.0:1788535920.152773:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+35:2355:x1875415589222656:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535920.152788:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535920.152826:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3d6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156c9 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.152846:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:3.0:1788535920.152855:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535920.152933:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+34:2355:x1875415589222656:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 162us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535920.152940:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788535920.154497:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535920.154615:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589222912 00000100:00100000:3.0:1788535920.154625:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589222912 00000100:00100000:3.0:1788535920.154679:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788535920.154688:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+34:10346:x1875415589222912:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:3.0:1788535920.155268:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+35:10346:x1875415589222912:12345-192.168.203.12@tcp:35:cat.0 Request processed in 577us (773us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788535920.155277:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1788535920.208665:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535920.208759:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589223168 00000100:00100000:3.0:1788535920.208768:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589223168 00000100:00100000:3.0:1788535920.208829:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1788535920.208839:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+35:10352:x1875415589223168:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1788535920.208872:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535920.208875:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788535920.208933:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3cd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751569f expref: 35 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.208967:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:3.0:1788535920.208972:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535920.208985:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3d7d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975156d0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.209083:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.209097:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d3d53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156c2 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.209106:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.209137:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d3d53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156c2 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.209151:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d3d53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156c2 expref: 35 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535920.209165:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6697:1875415607078144:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535920.209256:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b668bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535920.212770:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6697:1875415607078144:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788535920.212799:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535920.212984:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535920.213046:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589223296 00000100:00100000:1.0:1788535920.213053:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589223296 00010000:00010000:1.0:1788535920.213089:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d3d53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156c2 expref: 36 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535920.213133:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1788535920.213143:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+36:2356:x1875415589223296:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535920.213157:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535920.213164:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d3d53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156c2 expref: 36 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.213175:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d3d53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156c2 expref: 36 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.213197:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d3d53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156c2 expref: 36 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.213213:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:1.0:1788535920.213218:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.213228:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.213236:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.213279:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535920.213336:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+35:2356:x1875415589223296:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 194us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535920.213344:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00010000:00010000:3.0:1788535920.213711:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.213728:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535920.213746:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788535920.213941:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3d7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156d0 expref: 36 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.213958:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156d0 expref: 35 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.213966:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:3.0:1788535920.213970:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788535920.213973:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b800, rc 0) 00000100:00100000:3.0:1788535920.214013:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+35:10352:x1875415589223168:12345-192.168.203.12@tcp:101:dd.0 Request processed in 5175us (5358us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788535920.214021:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1788535920.223500:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535920.224860:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589223552 00000100:00100000:1.0:1788535920.224872:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589223552 00000100:00100000:1.0:1788535920.225017:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:1.0:1788535920.225027:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+35:10352:x1875415589223552:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:1.0:1788535920.225331:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.225347:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.225359:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788535920.225401:0:11644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788535920.225420:0:11644:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000d6abe747 reply state 00000000837a3b23 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535920.225429:0:11644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535920.225555:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+38:10352:x1875415589223552:12345-192.168.203.12@tcp:36:dd.0 Request processed in 529us (2067us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788535920.225562:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000020:00080000:1.0:1788535920.225566:0:11644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788535920.249944:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.249963:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.249971:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.249978:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0aa00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535920.249983:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.250015:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.250033:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:3.0:1788535920.250037:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535920.250043:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.250049:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3d92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.525568:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535920.539560:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535920.539750:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589223680 00000100:00100000:0.0:1788535920.539760:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589223680 00000100:00100000:0.0:1788535920.539830:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788535920.539842:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+37:10366:x1875415589223680:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:0.0:1788535920.539866:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535920.539919:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975156d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.539995:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3da0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.540027:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3da0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.540042:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3da0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.540060:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3da7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.540067:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.540073:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.540171:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d3dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.540182:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156d0 expref: 38 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.540190:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d3dae lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.540227:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156d0 expref: 38 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.540242:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156d0 expref: 38 pid: 6697 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535920.540269:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875415607078272:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535920.540506:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788535920.545236:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535920.545368:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875415607078272:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535920.545394:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d3dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535920.545705:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589223936 00000100:00100000:1.0:1788535920.545714:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589223936 00000100:00100000:1.0:1788535920.545778:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788535920.545801:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+39:5592:x1875415589223936:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788535920.546202:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+40:5592:x1875415589223936:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 401us (973us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788535920.546210:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788535920.548772:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535920.548857:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589224064 00000100:00100000:3.0:1788535920.548868:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589224064 00010000:00010000:3.0:1788535920.548936:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156d0 expref: 40 pid: 6697 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535920.548977:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:3.0:1788535920.548986:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+40:2358:x1875415589224064:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535920.548999:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535920.549006:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156d0 expref: 40 pid: 6697 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.549019:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156d0 expref: 40 pid: 6697 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.549051:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3d84 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156d0 expref: 40 pid: 6697 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.549083:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:3.0:1788535920.549088:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d3dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.549099:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d3dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.549106:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d3dae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.549138:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535920.549517:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+39:2358:x1875415589224064:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 529us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535920.549526:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00010000:00010000:0.0:1788535920.549781:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d3dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.549789:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d3dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535920.549830:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788535920.549835:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535920.549877:0:5833:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d3dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.549928:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d3dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.549939:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3da0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.549945:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3da0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.549952:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3da0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.549957:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecbe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535920.549969:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3da0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.549977:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3da0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.549987:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:0.0:1788535920.549990:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535920.549994:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3da0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.550000:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3da0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.550013:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.550018:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3da7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.550024:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3da7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.550028:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535920.550031:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3da7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.550046:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3da7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.550054:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a9a0685400) 00010000:00010000:0.0:1788535920.550056:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535920.550065:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3da7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.550070:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3da7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.550111:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d3d99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156d7 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.550124:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d3dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156d7 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.550131:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:0.0:1788535920.550134:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535920.550141:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecb200, rc 0) 00000100:00100000:0.0:1788535920.550176:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+38:10366:x1875415589223680:12345-192.168.203.12@tcp:101:stat.0 Request processed in 10337us (10626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535920.550184:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:2.0:1788535920.639022:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535920.639135:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589224320 00000100:00100000:3.0:1788535920.639145:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589224320 00000100:00100000:3.0:1788535920.639207:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:3.0:1788535920.639218:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+38:10372:x1875415589224320:12345-192.168.203.12@tcp:36:truncate.0 00010000:00010000:3.0:1788535920.639300:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535920.639328:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d3dae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156d7 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.639347:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:3.0:1788535920.639351:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535920.639589:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3db5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.639604:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3db5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.639622:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3db5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535920.639677:0:6697:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788535920.639703:0:6697:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000004d8df3be reply state 00000000b20b74ad transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3db5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535920.639711:0:6697:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535920.639826:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+40:10372:x1875415589224320:12345-192.168.203.12@tcp:36:truncate.0 Request processed in 609us (813us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788535920.639845:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000020:00080000:3.0:1788535920.639850:0:6697:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788535920.649222:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3db5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.649242:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3db5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.649250:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3db5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.649256:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535920.649261:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3db5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.649270:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3db5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.649410:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:3.0:1788535920.649415:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535920.649437:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3db5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.649443:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3db5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535920.796121:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535920.799465:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589224448 00000100:00100000:1.0:1788535920.799482:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589224448 00000100:00100000:1.0:1788535920.799632:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1788535920.799644:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+39:10386:x1875415589224448:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:1.0:1788535920.799666:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535920.799688:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3dbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975156de expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.799753:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3dc3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.799777:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3dc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.799789:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3dc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.799803:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3dca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.799811:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3dca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.799818:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3dca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800094:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3dd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800104:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800111:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535920.800142:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788535920.800147:0:11644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535920.800169:0:11644:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800181:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800189:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3dc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800196:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3dc3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800202:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3dc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800208:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535920.800213:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3dc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800221:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3dc3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800253:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:1.0:1788535920.800256:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535920.800268:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3dc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800274:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3dc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800288:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3dca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800294:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3dca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800300:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3dca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800309:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ae00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535920.800312:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3dca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800319:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3dca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800327:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a9888adc00) 00010000:00010000:1.0:1788535920.800329:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535920.800332:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3dca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800338:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3dca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800382:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3dbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156de expref: 41 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800396:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156de expref: 40 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.800404:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:1.0:1788535920.800406:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535920.800409:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0ba00, rc 0) 00000100:00100000:1.0:1788535920.800481:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+40:10386:x1875415589224448:12345-192.168.203.12@tcp:101:stat.0 Request processed in 839us (4365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535920.800489:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:2.0:1788535920.881337:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535920.881444:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589224704 00000100:00100000:0.0:1788535920.881454:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589224704 00000100:00100000:0.0:1788535920.881512:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1788535920.881523:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+40:10396:x1875415589224704:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535920.881544:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535920.881564:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3dd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975156e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535920.881725:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788535920.881836:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3dd8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156e5 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.881948:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9a0685800) 00010000:00010000:0.0:1788535920.881951:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788535920.881957:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3dd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156e5 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.881968:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecb400, rc 0) 00000100:00100000:0.0:1788535920.882170:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+41:10396:x1875415589224704:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 649us (843us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788535920.882177:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1788535920.884973:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535920.885064:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589224960 00000100:00100000:1.0:1788535920.885074:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589224960 00000100:00100000:1.0:1788535920.885117:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788535920.885126:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+41:10396:x1875415589224960:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788535920.885330:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+42:10396:x1875415589224960:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 204us (365us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788535920.885337:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788535920.936650:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535920.936746:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589225216 00000100:00100000:3.0:1788535920.936755:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589225216 00000100:00100000:3.0:1788535920.936809:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:3.0:1788535920.936818:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+42:10402:x1875415589225216:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788535920.936840:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535920.936869:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3de6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975156ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.937001:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.937015:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3dd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156de expref: 43 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.937024:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.937216:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156de expref: 43 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.937230:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3dd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156de expref: 43 pid: 11644 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535920.937243:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875415607078400:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535920.937351:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b668b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788535920.940291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535920.940376:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589225344 00000100:00100000:0.0:1788535920.940385:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589225344 00010000:00010000:0.0:1788535920.940425:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3dd1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156de expref: 44 pid: 11644 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535920.940538:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875415607078400:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788535920.940561:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535920.940781:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788535920.940792:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+44:2356:x1875415589225344:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535920.940806:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535920.940814:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3dd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156de expref: 44 pid: 11644 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.940825:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156de expref: 44 pid: 11644 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.940845:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d3dd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156de expref: 44 pid: 11644 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.940941:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:0.0:1788535920.940946:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.940956:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.940963:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.940991:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535920.941107:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+43:2356:x1875415589225344:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 316us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535920.941115:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00010000:00010000:3.0:1788535920.941168:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.941175:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535920.941193:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788535920.941332:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3de6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156ec expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.941348:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156ec expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.941356:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:3.0:1788535920.941359:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788535920.941361:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b600, rc 0) 00000100:00100000:3.0:1788535920.941385:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+43:10402:x1875415589225216:12345-192.168.203.12@tcp:101:bash.0 Request processed in 4568us (4754us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788535920.941392:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1788535920.944192:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535920.944406:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589225600 00000100:00100000:1.0:1788535920.944416:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589225600 00000100:00100000:1.0:1788535920.944468:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:1.0:1788535920.944478:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+43:10402:x1875415589225600:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:1.0:1788535920.945185:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3dfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.945222:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3dfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.945235:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3dfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788535920.945292:0:11644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788535920.945317:0:11644:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000008be69c26 reply state 000000001acf7732 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3dfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535920.945325:0:11644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535920.945445:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+46:10402:x1875415589225600:12345-192.168.203.12@tcp:36:bash.0 Request processed in 967us (1259us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788535920.945453:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000020:00080000:1.0:1788535920.945458:0:11644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788535920.948411:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3dfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.948429:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3dfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.948456:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3dfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.948463:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ac00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535920.948468:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3dfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.948476:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3dfb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.948491:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:3.0:1788535920.948494:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535920.948498:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3dfb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535920.948505:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d3dfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535920.953653:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535920.953875:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589225728 00000100:00100000:0.0:1788535920.953923:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589225728 00000100:00100000:0.0:1788535920.953975:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:0.0:1788535920.953985:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+45:10402:x1875415589225728:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788535920.954005:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535920.954024:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3e02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975156f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.954110:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3e09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.954124:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156ec expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.954150:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3e09 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.954182:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156ec expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.954194:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156ec expref: 46 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535920.954207:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875415607078528:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535920.954279:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535920.958392:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535920.958610:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589225856 00000100:00100000:1.0:1788535920.958620:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589225856 00010000:00010000:1.0:1788535920.958657:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156ec expref: 47 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535920.958698:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1788535920.958708:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+47:2356:x1875415589225856:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535920.958723:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535920.958731:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156ec expref: 47 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.958744:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156ec expref: 47 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.958782:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:1.0:1788535920.958787:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3e09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.958796:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.958802:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3e09 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535920.958822:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535920.958883:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+47:2356:x1875415589225856:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 176us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535920.958929:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00010000:00010000:0.0:1788535920.959234:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d3ded lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156ec expref: 46 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535920.959252:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7379180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875415607078528:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535920.959271:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.959281:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.959287:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535920.959332:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788535920.959337:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535920.959356:0:5833:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.959458:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d3e02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156f3 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.959473:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3e09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156f3 expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535920.959480:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:0.0:1788535920.959482:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535920.959485:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecbe00, rc 0) 00000100:00100000:0.0:1788535920.959511:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+45:10402:x1875415589225728:12345-192.168.203.12@tcp:101:bash.0 Request processed in 5528us (5879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535920.959518:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1788535920.963198:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535920.963290:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589226112 00000100:00100000:1.0:1788535920.963299:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589226112 00000100:00100000:1.0:1788535920.963360:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788535920.963370:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99c789450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+45:10402:x1875415589226112:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:1.0:1788535920.963936:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99c789450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+46:10402:x1875415589226112:12345-192.168.203.12@tcp:35:bash.0 Request processed in 565us (744us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788535920.963944:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1788535921.038454:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535921.038696:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589226368 00000100:00100000:3.0:1788535921.038705:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589226368 00000100:00100000:3.0:1788535921.038779:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1788535921.038789:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+46:10412:x1875415589226368:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535921.038814:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535921.038833:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975156fa expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535921.038965:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788535921.039196:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e10 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156fa expref: 48 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.039228:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9a0685800) 00010000:00010000:3.0:1788535921.039231:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535921.039237:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156fa expref: 48 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.039250:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b800, rc 0) 00000100:00100000:3.0:1788535921.039307:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+47:10412:x1875415589226368:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 519us (861us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788535921.039314:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00080000:1.0:1788535921.040223:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535921.041739:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.041933:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589226496 00000100:00100000:1.0:1788535921.041942:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589226496 00000100:00100000:1.0:1788535921.041987:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1788535921.041996:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+47:10412:x1875415589226496:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:1.0:1788535921.042071:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3e1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042091:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3e1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042103:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3e1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042118:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3e25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042125:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042130:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042207:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042216:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042222:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788535921.042258:0:11644:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042270:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3e1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042275:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3e1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042291:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3e1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042297:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ae00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535921.042301:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3e1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042308:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3e1e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042319:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:1.0:1788535921.042322:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535921.042326:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3e1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042332:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3e1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042346:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042352:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3e25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042357:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3e25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042362:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535921.042364:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3e25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042380:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3e25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042388:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a9888adc00) 00010000:00010000:1.0:1788535921.042391:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535921.042394:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3e25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042399:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3e25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042413:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042418:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042424:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042430:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535921.042433:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042439:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042446:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:1.0:1788535921.042448:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535921.042451:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.042477:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535921.042557:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+47:10412:x1875415589226496:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 560us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.042564:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1788535921.046394:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535921.046487:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589226752 00000100:00100000:3.0:1788535921.046497:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589226752 00000100:00100000:3.0:1788535921.046556:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788535921.046575:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+47:10412:x1875415589226752:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788535921.046806:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+48:10412:x1875415589226752:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 240us (421us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788535921.046814:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788535921.074342:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535921.074555:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589227008 00000100:00100000:0.0:1788535921.074573:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589227008 00000100:00100000:0.0:1788535921.074633:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:0.0:1788535921.074643:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+48:10415:x1875415589227008:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535921.074667:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535921.074686:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3e33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515701 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.074756:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.074770:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.074798:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.074813:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.074820:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.074827:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.074975:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3e48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.074984:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.074991:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535921.075001:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788535921.075411:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.075420:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e3a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.075427:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.075433:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535921.075447:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.076193:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.076216:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:0.0:1788535921.076219:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535921.076232:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.076239:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.076255:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.076261:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.076267:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.076273:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535921.076276:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.076281:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.076288:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a9a0685400) 00010000:00010000:0.0:1788535921.076290:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535921.076308:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.076314:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.076365:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3e33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515701 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.076380:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515701 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.076387:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:0.0:1788535921.076390:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535921.076392:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecba00, rc 0) 00000100:00100000:0.0:1788535921.076635:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+50:10415:x1875415589227008:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1992us (2300us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788535921.076644:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:2.0:1788535921.082824:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535921.082865:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.082967:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589227264 00000100:00100000:1.0:1788535921.082978:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589227264 00000100:00100000:1.0:1788535921.083058:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788535921.083068:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+50:2358:x1875415589227264:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535921.083083:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535921.083106:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3e48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515701 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.083125:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:1.0:1788535921.083130:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535921.083184:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+49:2358:x1875415589227264:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 118us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.083191:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788535921.083934:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589227136 00000100:00100000:3.0:1788535921.083941:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589227136 00000100:00100000:3.0:1788535921.083982:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1788535921.083990:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+49:10415:x1875415589227136:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1788535921.084052:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.084068:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.084099:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.084125:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.084131:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.084137:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.084142:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535921.084147:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.084154:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.084163:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:3.0:1788535921.084166:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535921.084170:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.084176:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535921.084230:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+49:10415:x1875415589227136:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 241us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535921.084238:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1788535921.087435:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535921.087508:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589227520 00000100:00100000:3.0:1788535921.087532:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589227520 00000100:00100000:3.0:1788535921.087592:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1788535921.087602:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+49:10415:x1875415589227520:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788535921.087828:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+50:10415:x1875415589227520:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 227us (401us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788535921.087835:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788535921.235325:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535921.235408:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589227776 00000100:00100000:0.0:1788535921.235417:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589227776 00000100:00100000:0.0:1788535921.235483:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:0.0:1788535921.235501:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+50:10433:x1875415589227776:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1788535921.235524:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535921.235542:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3e5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515708 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.235648:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.235678:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.235689:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535921.235701:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788535921.235830:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3e5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515708 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.235848:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515708 expref: 52 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.235856:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:0.0:1788535921.235871:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788535921.235875:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987eca000, rc 0) 00000100:00100000:0.0:1788535921.235987:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+52:10433:x1875415589227776:12345-192.168.203.12@tcp:101:cat.0 Request processed in 487us (670us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788535921.235994:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:2.0:1788535921.272157:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535921.272273:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589227904 00000100:00100000:0.0:1788535921.272282:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589227904 00000100:00100000:0.0:1788535921.272341:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:0.0:1788535921.272351:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+52:10434:x1875415589227904:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535921.272376:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535921.272399:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3e72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751570f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.272507:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.272521:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.272547:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535921.272595:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788535921.272599:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535921.272618:0:5833:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.272646:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3e72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751570f expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.272666:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751570f expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.272674:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:0.0:1788535921.272677:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788535921.272682:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecb800, rc 0) 00000100:00100000:0.0:1788535921.272746:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+53:10434:x1875415589227904:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 396us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.272755:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1788535921.281438:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535921.281512:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589228288 00000100:00100000:3.0:1788535921.281521:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589228288 00000100:00100000:3.0:1788535921.281618:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:3.0:1788535921.281641:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+53:10434:x1875415589228288:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788535921.285278:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+54:10434:x1875415589228288:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 3629us (3836us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788535921.285292:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788535921.290452:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.292193:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589228416 00000100:00100000:1.0:1788535921.292208:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589228416 00000100:00100000:1.0:1788535921.292290:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788535921.292302:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+54:10434:x1875415589228416:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:1.0:1788535921.292317:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788535921.292347:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3e09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156f3 expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.292389:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3e64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515708 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.292401:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2051800/0x74f51638375d3d14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975156b4 expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.292411:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685b00) 00010000:00010000:1.0:1788535921.292421:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535921.292490:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+51:10434:x1875415589228416:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 190us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.292497:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1788535921.297382:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.297609:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589228544 00000100:00100000:1.0:1788535921.297619:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589228544 00000100:00100000:1.0:1788535921.297682:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:1.0:1788535921.297692:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+51:10434:x1875415589228544:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:1.0:1788535921.297827:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.297843:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.297854:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788535921.298195:0:11644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788535921.298397:0:11644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788535921.298458:0:11644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788535921.298585:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+51:10434:x1875415589228544:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 892us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.298594:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:2.0:1788535921.320391:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535921.322764:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589228672 00000100:00100000:3.0:1788535921.322779:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589228672 00000100:00100000:3.0:1788535921.322906:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:3.0:1788535921.322916:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+51:10436:x1875415589228672:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535921.322935:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535921.322956:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515716 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323029:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3e8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323044:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3e8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323055:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3e8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323069:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3e95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323091:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3e95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323097:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3e95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323183:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3e9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323192:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323199:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535921.323235:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788535921.323239:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788535921.323269:0:5832:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323280:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323288:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3e8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323296:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3e8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323302:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3e8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323317:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535921.323322:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3e8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323329:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3e8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323341:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:3.0:1788535921.323344:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535921.323348:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3e8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323355:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3e8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323369:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3e95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323375:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3e95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323381:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3e95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323387:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535921.323389:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3e95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323395:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3e95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323410:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a997503700) 00010000:00010000:3.0:1788535921.323413:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535921.323416:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3e95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323422:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3e95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323453:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3e87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515716 expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323465:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515716 expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.323472:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:3.0:1788535921.323474:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788535921.323476:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4a600, rc 0) 00000100:00100000:3.0:1788535921.323559:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+52:10436:x1875415589228672:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 644us (3178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535921.323575:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000040:00080000:2.0:1788535921.422174:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788535921.422182:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788535921.422232:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788535921.422238:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788535921.422346:0:11640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b26a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11640:1875415607078784:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788535921.422389:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607078912:0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.422438:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535921.422448:0:11640:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860c0240 going to sleep for 11 seconds 00000100:00100000:3.0:1788535921.422470:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607079424:0@lo:400:kworker.0 00000100:00100000:2.0:1788535921.422483:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607079168:0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.422498:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535921.422515:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788535921.422521:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607078656:0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.422554:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535921.422593:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607079296:0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.422614:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535921.422642:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607078656 00000100:00100000:3.0:1788535921.422648:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607078656 00000100:00100000:3.0:1788535921.422681:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788535921.422688:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3309:x1875415607078656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.422738:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3309:x1875415607078656:12345-0@lo:400:kworker.0 Request processed in 51us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535921.422745:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788535921.422782:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607078656:0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.422802:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607078912 00000100:00100000:3.0:1788535921.422805:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607078912 00000100:00100000:3.0:1788535921.422825:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607079296 00000100:00100000:3.0:1788535921.422827:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607079296 00000100:00100000:3.0:1788535921.422846:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788535921.422851:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607078912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.422880:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607078912:12345-0@lo:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535921.422907:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788535921.422918:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788535921.422923:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875415607079296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.422944:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875415607079296:12345-0@lo:400:kworker.0 Request processed in 22us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535921.422950:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788535921.422970:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607079296:0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.422986:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607078912:0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.423007:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607079040:0@lo:400:kworker.0 00000100:00100000:2.0:1788535921.423128:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535921.423178:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535921.423211:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607079040 00000100:00100000:2.0:1788535921.423216:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607079040 00000100:00100000:2.0:1788535921.423252:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788535921.423259:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607079040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535921.423294:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607079040:12345-0@lo:400:kworker.0 Request processed in 35us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535921.423301:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1788535921.423370:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535921.423383:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607079424 00000100:00100000:1.0:1788535921.423386:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607079424 00000100:00100000:1.0:1788535921.423427:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607079168 00000100:00100000:1.0:1788535921.423430:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607079168 00000100:00100000:1.0:1788535921.423448:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788535921.423455:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607079424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535921.423491:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607079424:12345-0@lo:400:kworker.0 Request processed in 38us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.423497:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788535921.423508:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788535921.423514:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875415607079168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535921.423544:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875415607079168:12345-0@lo:400:kworker.0 Request processed in 31us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.423550:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788535921.423592:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607079168:0@lo:400:kworker.0 00000100:00080000:2.0:1788535921.425109:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535921.425117:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535921.425577:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607079040:0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.425620:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607079424:0@lo:400:kworker.0 00000100:00100000:1.0:1788535921.427616:0:11640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b26a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11640:1875415607078784:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788535921.433051:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.433426:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589228800 00000100:00100000:1.0:1788535921.433436:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589228800 00000100:00100000:1.0:1788535921.433493:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:1.0:1788535921.433505:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:30a1922d-0d3f-4681-a966-cec3672631c6+52:10447:x1875415589228800:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788535921.433602:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:30a1922d-0d3f-4681-a966-cec3672631c6+52:10447:x1875415589228800:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 Request processed in 100us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.433621:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1788535921.436122:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535921.436196:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589228928 00000100:00100000:0.0:1788535921.436204:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589228928 00000100:00100000:0.0:1788535921.436253:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1788535921.436261:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+52:10447:x1875415589228928:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788535921.436289:0:5834:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788535921.436382:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+52:10447:x1875415589228928:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 121us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.436390:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1788535921.440446:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.442496:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589229056 00000100:00100000:1.0:1788535921.442509:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589229056 00000100:00100000:1.0:1788535921.442587:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:1.0:1788535921.442598:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+52:10447:x1875415589229056:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788535921.442667:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3ea3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442682:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442694:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442708:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3eaa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442716:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3eaa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442722:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3eaa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442747:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3eb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442755:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442762:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535921.442821:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788535921.442825:0:11644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535921.442835:0:11644:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442846:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442853:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3ea3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442860:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442865:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ae00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535921.442869:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442876:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3ea3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442924:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a99742a400) 00010000:00010000:1.0:1788535921.442928:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535921.442933:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3ea3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442940:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3ea3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442953:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3eaa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442968:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3eaa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442975:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3eaa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442979:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535921.442983:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3eaa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442990:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3eaa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.442998:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff97a9888ad600) 00010000:00010000:1.0:1788535921.443001:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535921.443003:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3eaa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.443010:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3eaa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.443024:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.443030:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3eb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.443036:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.443040:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535921.443048:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.443054:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3eb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.443062:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:1.0:1788535921.443064:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535921.443067:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3eb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.443072:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3eb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535921.443139:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+52:10447:x1875415589229056:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 543us (2701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.443148:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:1.0:1788535921.446829:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535921.446992:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589229312 00000100:00100000:3.0:1788535921.447003:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589229312 00000100:00100000:3.0:1788535921.447070:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:3.0:1788535921.447082:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+52:10447:x1875415589229312:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535921.447101:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535921.447119:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3eb8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751571d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.447207:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3ebf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.447221:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.447231:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535921.447241:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788535921.447334:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.447359:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3ebf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.447365:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3ebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.447371:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535921.447376:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3ebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.447384:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3ebf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.447397:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:3.0:1788535921.447401:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788535921.447405:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3ebf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.447411:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3ebf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.447450:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3eb8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751571d expref: 54 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.447460:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a99742a400) 00010000:00010000:3.0:1788535921.447462:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535921.447466:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3eb8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751571d expref: 54 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.447474:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b800, rc 0) 00000100:00100000:3.0:1788535921.447546:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+53:10447:x1875415589229312:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 467us (727us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788535921.447553:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:3.0:1788535921.469021:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535921.469539:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589229440 00000100:00100000:2.0:1788535921.469550:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589229440 00000100:00100000:2.0:1788535921.469622:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:2.0:1788535921.469632:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+53:10447:x1875415589229440:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788535921.469667:0:5832:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788535921.469993:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+53:10447:x1875415589229440:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 361us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535921.470001:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:1.0:1788535921.473602:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535921.474554:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589229696 00000100:00100000:2.0:1788535921.474576:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589229696 00000100:00100000:2.0:1788535921.474643:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:2.0:1788535921.474653:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+53:10447:x1875415589229696:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535921.474674:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535921.474678:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788535921.474705:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d3e79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751570f expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.474722:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:2.0:1788535921.474727:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535921.474739:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d3ecd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515724 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788535921.475179:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788535921.475375:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3ed4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.475401:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.475411:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.475483:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d3ecd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515724 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.475500:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515724 expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.475507:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:2.0:1788535921.475510:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535921.475513:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747f800, rc 0) 00000100:00100000:2.0:1788535921.475581:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+54:10447:x1875415589229696:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 929us (1989us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788535921.475589:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:1.0:1788535921.497666:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535921.499733:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589229952 00000100:00100000:2.0:1788535921.499746:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589229952 00000100:00100000:2.0:1788535921.499798:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:2.0:1788535921.499808:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+54:10447:x1875415589229952:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788535921.499866:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535921.499907:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3ed4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515724 expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.499924:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:2.0:1788535921.499944:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535921.499966:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3ee2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.499980:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3ee2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.499990:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3ee2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500004:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3ee9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd3634bad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500011:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3634bad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500017:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3634bad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500075:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3ee2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500083:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3ee2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500090:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3ee2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500097:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535921.500101:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3ee2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500108:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3ee2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500124:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:2.0:1788535921.500128:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535921.500132:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3ee2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500139:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3ee2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500149:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3634bad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500155:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3ee9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3634bad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500160:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3ee9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3634bad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500166:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535921.500169:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3ee9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3634bad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500175:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3ee9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3634bad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500182:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd3634bad (ffff97a99742a100) 00010000:00010000:2.0:1788535921.500184:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535921.500187:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3ee9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd3634bad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.500193:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d3ee9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd3634bad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535921.500288:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+53:10447:x1875415589229952:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 481us (2630us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788535921.500302:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:3.0:1788535921.503866:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535921.507004:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589230080 00000100:00100000:2.0:1788535921.507019:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589230080 00000100:00100000:2.0:1788535921.507105:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:2.0:1788535921.507117:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+53:10447:x1875415589230080:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535921.507327:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535921.507353:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d3ef0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751572b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.507390:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3ef7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.507404:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.507420:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.507509:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d3ef0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751572b expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.507528:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751572b expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.507536:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a99742a600) 00010000:00010000:2.0:1788535921.507545:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788535921.507549:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747ee00, rc 0) 00000100:00100000:2.0:1788535921.507637:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+54:10447:x1875415589230080:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 522us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535921.507644:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:3.0:1788535921.509996:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.510380:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589230336 00000100:00100000:1.0:1788535921.510390:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589230336 00000100:00100000:1.0:1788535921.510516:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:1.0:1788535921.510527:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+54:10447:x1875415589230336:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788535921.510632:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3efe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.510650:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3efe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.510661:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3efe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788535921.511301:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1788535921.511313:0:6697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323642424919ns, next at 324642422148ns, rc = 0 00000004:00010000:1.0:1788535921.511399:0:6697:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000001f6a391f reply state 000000003f0f0559 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3efe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535921.511408:0:6697:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535921.512534:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+56:10447:x1875415589230336:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 2001us (2540us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788535921.512545:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00010000:00010000:2.0:1788535921.515319:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3efe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.515337:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3efe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.515345:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3efe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.515351:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535921.515356:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3efe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.515365:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3efe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.515382:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a99742a600) 00010000:00010000:2.0:1788535921.515385:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788535921.515392:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3efe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.515399:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d3efe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535921.520262:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.521135:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589230464 00000100:00100000:1.0:1788535921.521146:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589230464 00000100:00100000:1.0:1788535921.521212:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1788535921.521223:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+55:10447:x1875415589230464:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788535921.521246:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535921.521267:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3f05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515732 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.521332:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3f05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515732 expref: 56 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.521347:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3f05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515732 expref: 56 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.521368:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a99742a600) 00010000:00010000:1.0:1788535921.521371:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788535921.521375:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0ae00, rc 0) 00000100:00100000:1.0:1788535921.521526:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+56:10447:x1875415589230464:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 304us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.521533:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:0.0:1788535921.526055:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535921.526099:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535921.526124:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535921.526126:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589230720 00000100:00100000:0.0:1788535921.526150:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589230848 00000100:00100000:0.0:1788535921.526158:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589230848 00000100:00100000:0.0:1788535921.526217:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:0.0:1788535921.526228:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2357:x1875415589230848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535921.526300:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589230720 00000100:00100000:0.0:1788535921.526322:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2357:x1875415589230848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 94us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.526331:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:2.0:1788535921.526344:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00080000:0.0:1788535921.526358:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788535921.526363:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535921.526369:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2357:x1875415589230720:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535921.526404:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2357:x1875415589230720:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535921.526411:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1788535921.527004:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589230592 00000100:00100000:3.0:1788535921.527010:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589230592 00000100:00100000:3.0:1788535921.527061:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 278 00000100:00100000:3.0:1788535921.527069:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2357:x1875415589230592:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535921.527110:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2357:x1875415589230592:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 42us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535921.527117:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 278 00000100:00100000:0.0:1788535921.532172:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535921.532360:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589230976 00000100:00100000:2.0:1788535921.532369:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589230976 00000100:00100000:2.0:1788535921.532462:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1788535921.532470:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1875415589230976:12345-192.168.203.12@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788535921.532499:0:6674:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:2.0:1788535921.532604:0:6674:0:(genops.c:1385:class_connect()) connect: client 30a1922d-0d3f-4681-a966-cec3672631c6, cookie 0x74f51638375d3f0c 00002000:00100000:2.0:1788535921.532616:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 30a1922d-0d3f-4681-a966-cec3672631c6/ffff97a9bfc93000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788535921.532641:0:6674:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788535921.533200:0:6674:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788535921.533236:0:6674:0:(import.c:65:import_set_state_nolock()) ffff97a9bfc96800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788535921.533311:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2354:x1875415589230976:12345-192.168.203.12@tcp:8:lhsmtool_posix.0 Request processed in 840us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535921.533320:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1788535921.540605:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535921.540708:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589231104 00000100:00100000:3.0:1788535921.540719:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589231104 00000100:00100000:3.0:1788535921.540796:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:3.0:1788535921.540807:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+6:0:x1875415589231104:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788535921.541398:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788535921.551736:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788535921.662821:0:7609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 30a1922d-0d3f-4681-a966-cec3672631c6 00000001:00080000:0.0:1788535921.662856:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1788535921.675695:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:0:x1875415589231104:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 134879us (135090us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788535921.675709:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:3.0:1788535921.680605:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.681021:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589231360 00000100:00100000:1.0:1788535921.681042:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589231360 00000100:00100000:1.0:1788535921.681103:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788535921.681113:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+56:10447:x1875415589231360:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788535921.681368:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+57:10447:x1875415589231360:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 256us (772us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788535921.681376:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1788535921.685508:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.685706:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589231616 00000100:00100000:1.0:1788535921.685716:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589231616 00000100:00100000:1.0:1788535921.685775:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:1.0:1788535921.685785:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+57:10447:x1875415589231616:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788535921.686130:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+57:10447:x1875415589231616:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 343us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.686138:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1788535921.689554:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.689667:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589231744 00000100:00100000:1.0:1788535921.689677:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589231744 00000100:00100000:1.0:1788535921.689737:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1788535921.689748:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+57:10447:x1875415589231744:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788535921.689768:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535921.689794:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3f13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515739 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.689877:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3f1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.690025:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3f1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.690049:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3f1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535921.690086:0:11644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535921.690106:0:11644:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3f1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.690133:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d3f13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515739 expref: 59 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.690150:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3f1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515739 expref: 58 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.690159:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a99742a600) 00010000:00010000:1.0:1788535921.690162:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788535921.690166:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a000, rc 0) 00000100:00100000:1.0:1788535921.690256:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+58:10447:x1875415589231744:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 509us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.690263:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1788535921.696092:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535921.696363:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589231872 00000100:00100000:0.0:1788535921.696373:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589231872 00000100:00100000:0.0:1788535921.696433:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:0.0:1788535921.696444:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+5:2357:x1875415589231872:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535921.696462:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535921.696482:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d3f21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515740 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535921.696507:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ae471, blocks: 0x1 00010000:00010000:0.0:1788535921.696526:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1788535921.696530:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535921.696540:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d3f21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515740 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.696559:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d3f21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515740 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.696584:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecbc00, rc 0) 00000100:00100000:0.0:1788535921.696650:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2357:x1875415589231872:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 207us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.696656:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1788535921.700069:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535921.700204:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589232128 00000100:00100000:0.0:1788535921.700214:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589232128 00000100:00100000:0.0:1788535921.700267:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:0.0:1788535921.700276:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+58:10447:x1875415589232128:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788535921.700380:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+58:10447:x1875415589232128:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 104us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.700401:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1788535921.703072:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535921.703206:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589232256 00000100:00100000:3.0:1788535921.703215:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589232256 00000100:00100000:3.0:1788535921.703268:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788535921.703278:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:10447:x1875415589232256:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535921.703294:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535921.703310:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d3f28 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515747 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.703347:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d3f21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515740 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.703355:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535921.703359:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535921.703364:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d3f28 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515747 expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.703398:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d3f21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515740 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.703421:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d3f21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515740 expref: 7 pid: 6671 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535921.703436:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8424:1875415607079552:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535921.703522:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b668bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788535921.710853:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535921.711304:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589232384 00000100:00100000:0.0:1788535921.711314:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589232384 00010000:00010000:0.0:1788535921.711357:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d3f21 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515740 expref: 8 pid: 6671 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535921.711403:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:0.0:1788535921.711424:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987ece050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589232384:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535921.711439:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535921.711463:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d3f21 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515740 expref: 8 pid: 6671 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.711478:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d3f21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515740 expref: 8 pid: 6671 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.711504:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535921.711509:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535921.711518:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d3f28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515747 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.711529:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d3f28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515747 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.711578:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d3f28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515747 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535921.711615:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf136680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875415607079680:192.168.203.12@tcp:105: 00000100:00100000:0.0:1788535921.711693:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788535921.713390:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d3f21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515740 expref: 8 pid: 6671 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535921.713417:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8424:1875415607079552:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535921.713446:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d3f28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515747 expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.713478:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b800, rc 0) 00000100:00100000:2.0:1788535921.713528:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+7:10447:x1875415589232256:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 10250us (10463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535921.713536:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:0.0:1788535921.716224:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf136680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875415607079680:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788535921.716248:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535921.716376:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987ece050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589232384:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4962us (5535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.716386:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1788535921.720789:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535921.721071:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589232512 00000100:00100000:3.0:1788535921.721081:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589232512 00002000:00100000:3.0:1788535921.721126:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97a984eb0e00 x1875415589232512/t0(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:577/0 lens 504/0 e 0 to 0 dl 1788535932 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788535921.721189:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a984eb0e00 with x1875415589232512 ext(0->8) 00002000:00010000:3.0:1788535921.721194:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a984eb0e00 00000100:00100000:3.0:1788535921.721248:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788535921.721271:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589232512:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788535921.722411:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589232512:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 1135us (1625us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788535921.722422:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00100000:3.0:1788535921.722432:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97a984eb0e00 x1875415589232512/t4294967302(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:577/0 lens 504/448 e 0 to 0 dl 1788535932 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788535921.722441:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a984eb0e00 with x1875415589232512 ext(0->8) 00002000:00010000:3.0:1788535921.722445:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a984eb0e00 00000100:00100000:0.0:1788535921.724526:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.724615:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589232640 00000100:00100000:1.0:1788535921.724626:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589232640 00000100:00100000:1.0:1788535921.724805:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1788535921.724816:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+58:10447:x1875415589232640:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788535921.797651:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+58:10447:x1875415589232640:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 72827us (73123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.798242:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000001:00080000:1.0:1788535921.798280:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:1.0:1788535921.798295:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788535921.798315:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a9ba21c180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788535921.798319:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9b74e6200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a9ba21c600 00000020:00080000:1.0:1788535921.798322:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9b74e6100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a98366cc00 00000001:00080000:1.0:1788535921.798347:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788535921.798352:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788535921.798426:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788535921.798620:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788535921.798878:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535921.799040:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a984eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607079808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788535921.799099:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535921.802202:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607079936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788535921.802280:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535921.807315:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607079808 00000100:00100000:3.0:1788535921.807330:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607079808 00000100:00100000:3.0:1788535921.807396:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607079936 00000100:00100000:3.0:1788535921.807400:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607079936 00000100:00100000:3.0:1788535921.807426:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788535921.807435:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607079808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788535921.807640:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788535921.807644:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788535921 00002000:00010000:3.0:1788535921.807646:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788535921.807648:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788535921 -> 1788535921 00002000:00010000:3.0:1788535921.807650:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788535921.807869:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535921.808075:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589232768 00000100:00100000:2.0:1788535921.808080:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589232768 00000100:00100000:2.0:1788535921.808107:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788535921.808115:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875415607079936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788535921.808133:0:6673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788535921.808164:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ae46f, atime: 0x6a9ae46f, ctime: 0x6a9ae46f, blocks: 0x1 00010000:00010000:2.0:1788535921.808171:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9bea23/0x74f51638375d3f2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.808186:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:2.0:1788535921.808190:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535921.808197:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9bea23/0x74f51638375d3f2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.808213:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec9bea23/0x74f51638375d3f2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.808224:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9bea23/0x74f51638375d3f2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.808233:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9bea23/0x74f51638375d3f2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.808274:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788535921.808779:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875415607079936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 662us (6496us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788535921.808787:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788535921.808809:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:2.0:1788535921.808818:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589232768:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788535921.809201:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875415607079808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1765us (10099us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788535921.809210:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:3.0:1788535921.809266:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a9b61ac700/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788535921.809273:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607079936:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788535921.809300:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a984eb2680/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788535921.809304:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a984eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607079808:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788535921.809386:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535921.809394:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec9bea23/0x74f51638375d3f2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.809410:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fe00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788535921.809415:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9bea23/0x74f51638375d3f2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.809425:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9bea23/0x74f51638375d3f2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.809443:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec9bea23/0x74f51638375d3f2f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.809450:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec9bea23/0x74f51638375d3f2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.809470:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535921.809472:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535921.809474:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535921.852987:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589232768:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 44160us (45110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535921.853000:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000001:00080000:2.0:1788535921.853043:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1788535921.853052:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1788535921.857500:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535921.857584:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589233024 00000100:00100000:3.0:1788535921.857594:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589233024 00000100:00100000:3.0:1788535921.858024:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:3.0:1788535921.858046:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+13:10447:x1875415589233024:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788535921.858097:0:11644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535921.858124:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3f1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515739 expref: 13 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.858142:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a99742a600) 00010000:00010000:3.0:1788535921.858147:0:11644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535921.858178:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.858191:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.858202:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535921.858430:0:11644:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000d4a5acf1 reply state 000000005de7a0b1 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535921.858439:0:11644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535921.858536:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+14:10447:x1875415589233024:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 493us (1046us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788535921.858545:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:1.0:1788535921.870381:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.870412:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589233152 00000100:00100000:1.0:1788535921.870421:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589233152 00000100:00100000:1.0:1788535921.870471:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1788535921.870482:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589233152:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788535921.870730:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788535921.870734:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788535921 -> 1788535921 00002000:00010000:1.0:1788535921.870737:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788535919 00002000:00010000:1.0:1788535921.870740:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788535921 -> 1788535921 00002000:00010000:1.0:1788535921.870753:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788535921.870811:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+7:2355:x1875415589233152:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 330us (439us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788535921.870819:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00010000:00010000:3.0:1788535921.871477:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.871489:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.871496:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.871502:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535921.871507:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.871514:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.871532:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a99742a600) 00010000:00010000:3.0:1788535921.871535:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535921.871540:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.871546:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535921.874246:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535921.874331:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589233408 00000100:00100000:2.0:1788535921.874340:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589233408 00000100:00100000:2.0:1788535921.874397:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:2.0:1788535921.874407:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+13:10447:x1875415589233408:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788535921.874469:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.874486:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751572b expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.874495:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.874529:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751572b expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.874550:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751572b expref: 13 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535921.874575:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607080064:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788535921.874695:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988780b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788535921.879472:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607080064:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535921.879502:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535921.884757:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535921.885247:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589233536 00000100:00100000:2.0:1788535921.885257:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589233536 00010000:00010000:2.0:1788535921.885295:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751572b expref: 14 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535921.885340:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1788535921.885350:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+14:2356:x1875415589233536:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535921.885362:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535921.885369:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751572b expref: 14 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.885383:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751572b expref: 14 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.885402:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d3ef7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751572b expref: 14 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.885430:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a99742a600) 00010000:00010000:2.0:1788535921.885435:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.885443:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.885451:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.885483:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535921.885534:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+13:2356:x1875415589233536:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 184us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535921.885541:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00010000:00010000:0.0:1788535921.885805:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.885814:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.885843:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.885850:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.885857:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.885863:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ea00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535921.885867:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.885875:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.885917:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a99742a600) 00010000:00010000:0.0:1788535921.885926:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788535921.885931:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.885938:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3f3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535921.885988:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+12:10447:x1875415589233408:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 11581us (11749us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788535921.885996:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:0.0:1788535921.901384:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.901457:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589233664 00000100:00100000:1.0:1788535921.901467:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589233664 00000100:00100000:1.0:1788535921.901524:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:1.0:1788535921.901535:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+7:2356:x1875415589233664:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788535921.901621:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.901640:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d3f28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515747 expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.901648:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788535921.901653:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535921.901658:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.901693:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d3f28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515747 expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.901708:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d3f28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515747 expref: 7 pid: 8424 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535921.901723:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6674:1875415607080192:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788535921.901821:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535921.910409:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.910508:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6674:1875415607080192:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535921.910535:0:6674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535921.910577:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589233792 00000100:00100000:1.0:1788535921.910583:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589233792 00010000:00010000:1.0:1788535921.910615:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d3f28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515747 expref: 8 pid: 8424 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535921.910654:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1788535921.910663:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:2356:x1875415589233792:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535921.910676:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535921.910697:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d3f28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515747 expref: 8 pid: 8424 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.910712:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d3f28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515747 expref: 8 pid: 8424 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.910737:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d3f28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515747 expref: 8 pid: 8424 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.910752:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535921.910756:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535921.910761:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.910784:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.910807:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535921.910865:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2356:x1875415589233792:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 203us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.910873:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00010000:00010000:1.0:1788535921.911019:0:6674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.911034:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.911058:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.911067:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.911074:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.911080:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ba00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788535921.911084:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.911102:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.911114:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.911121:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001621389d/0x74f51638375d3f44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535921.911169:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589233664:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 9636us (9794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.911177:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:0.0:1788535921.916176:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535921.919093:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589234048 00000100:00100000:1.0:1788535921.919107:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589234048 00000100:00100000:1.0:1788535921.919218:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:1.0:1788535921.919229:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+12:10447:x1875415589234048:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788535921.919312:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3f4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.919328:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3f4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.919339:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3f4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.919574:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.919599:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3f05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515732 expref: 13 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.919608:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.919647:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3f05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515732 expref: 13 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535921.919663:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3f05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515732 expref: 13 pid: 11644 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535921.919677:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6697:1875415607080320:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788535921.919763:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535921.926296:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535921.927976:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589234176 00000100:00100000:2.0:1788535921.927991:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589234176 00010000:00010000:2.0:1788535921.928254:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3f05 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515732 expref: 14 pid: 11644 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535921.928295:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1788535921.928306:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+14:2355:x1875415589234176:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535921.928320:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535921.928328:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3f05 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515732 expref: 14 pid: 11644 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.928341:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3f05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515732 expref: 14 pid: 11644 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.928381:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a99742a600) 00010000:00010000:2.0:1788535921.928386:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.928773:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.928801:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.928829:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535921.929185:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+14:2355:x1875415589234176:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 877us (2896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535921.929194:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00010000:00010000:2.0:1788535921.929258:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d3f05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515732 expref: 13 pid: 11644 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535921.929272:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6697:1875415607080320:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535921.929294:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.929304:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.929309:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535921.929492:0:6697:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788535921.929659:0:6697:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788535921.929706:0:6697:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788535921.932232:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf135f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6697:1875415607080448:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788535921.932295:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535921.932328:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987f88240 going to sleep for 11 seconds 00000100:00100000:1.0:1788535921.932386:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607080448 00000100:00100000:1.0:1788535921.932394:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607080448 00000100:00100000:1.0:1788535921.932444:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788535921.932453:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6697:x1875415607080448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788535921.932532:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6697:x1875415607080448:12345-0@lo:1000:mdt00_003.0 Request processed in 80us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535921.932540:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788535921.932653:0:6697:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788535921.932658:0:6697:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a984eb2680, transno 4294967303 00000100:00100000:0.0:1788535921.932675:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf135f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6697:1875415607080448:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788535921.933999:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607080576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535921.934066:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535921.934115:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607080576 00000100:00100000:2.0:1788535921.934121:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607080576 00000100:00100000:2.0:1788535921.934158:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788535921.934165:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607080576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535921.934183:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788535921.934222:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607080576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535921.934229:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788535921.934270:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607080576:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788535921.935201:0:6697:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788535921.935287:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf135f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6697:1875415607080704:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788535921.935334:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535921.935359:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987f88a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535921.935760:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607080704 00000100:00100000:1.0:1788535921.935768:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607080704 00000100:00100000:1.0:1788535921.935816:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788535921.935825:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6697:x1875415607080704:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788535921.936573:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6697:x1875415607080704:12345-0@lo:1000:mdt00_003.0 Request processed in 737us (1225us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788535921.936583:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788535921.936973:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf135f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6697:1875415607080704:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788535921.937013:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.937024:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.937570:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.937577:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0aa00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535921.937582:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.937591:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.937610:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a99742a600) 00010000:00010000:0.0:1788535921.937613:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788535921.937618:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.937625:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d3f52 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.937665:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.937672:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e80 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.937678:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.937683:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535921.937686:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.937703:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e80 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.937711:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:0.0:1788535921.937714:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788535921.937717:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e80 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.937722:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d3e80 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.938880:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.938922:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3e9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515716 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.938932:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.938975:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515716 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.938993:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3e9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515716 expref: 16 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535921.939011:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf134000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6697:1875415607080832:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535921.939120:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987f88a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535921.945256:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535921.946392:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589234304 00000100:00100000:2.0:1788535921.946405:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589234304 00010000:00010000:2.0:1788535921.946448:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3e9c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515716 expref: 17 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535921.946490:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:2.0:1788535921.946500:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+17:2356:x1875415589234304:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535921.946516:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535921.946523:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3e9c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515716 expref: 17 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.946535:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3e9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515716 expref: 17 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.946586:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:2.0:1788535921.946592:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.946602:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.946610:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535921.946629:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535921.946685:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+17:2356:x1875415589234304:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 185us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535921.946692:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00010000:00010000:0.0:1788535921.954929:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3e9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515716 expref: 16 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535921.954962:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf134000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6697:1875415607080832:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535921.954989:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.954998:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.955004:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.955016:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.955023:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.956264:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.956271:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535921.956276:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.956286:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.956304:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:0.0:1788535921.956307:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535921.956311:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.956332:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d3f59 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.956347:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3f4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.956353:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3f4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.956357:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3f4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.956362:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535921.956364:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3f4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.956369:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3f4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.956376:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:0.0:1788535921.956378:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788535921.956381:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3f4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535921.956386:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d3f4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535921.956664:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+15:10447:x1875415589234048:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 37432us (40493us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788535921.956675:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000020:00080000:0.0:1788535921.956690:0:6697:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788535921.956951:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535921.956956:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788535921.956983:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788535921.956989:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788535921.967716:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535921.967990:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589234560 00000100:00100000:3.0:1788535921.968000:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589234560 00000100:00100000:3.0:1788535921.968074:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788535921.968084:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+15:10447:x1875415589234560:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788535921.968753:0:5836:0:(mdd_object.c:4338:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788535921.968870:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788535921.968948:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.968964:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.968975:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.968983:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f60 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.968989:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f60 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.968994:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.969015:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788535921.970576:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+17:10447:x1875415589234560:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 2472us (2847us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788535921.970591:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000020:00080000:3.0:1788535921.970599:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788535921.970632:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535921.970640:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.970662:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788535921.970666:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.970675:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.970690:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97a997503700) 00010000:00010000:3.0:1788535921.970693:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788535921.970698:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f60 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.970704:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535921.970722:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535921.970724:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535921.970726:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788535922.246632:0:11958:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535922.246641:0:11958:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535922.246691:0:11958:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788535922.246697:0:11958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788535922.411611:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535922.415711:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589234816 00000100:00100000:1.0:1788535922.415730:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589234816 00000100:00100000:1.0:1788535922.416352:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:1.0:1788535922.416364:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+17:10457:x1875415589234816:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788535922.416386:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535922.416404:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3f67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751574e expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.416490:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3f6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.416503:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3f6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.416514:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3f6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535922.416525:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788535922.416649:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d3f67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751574e expref: 20 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.416663:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3f6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751574e expref: 19 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.416671:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:1.0:1788535922.416678:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788535922.416682:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0b200, rc 0) 00000100:00100000:1.0:1788535922.416759:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+19:10457:x1875415589234816:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 396us (5157us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788535922.416766:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:2.0:1788535922.419539:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535922.419638:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589234944 00000100:00100000:0.0:1788535922.419648:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589234944 00000100:00100000:0.0:1788535922.419801:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:0.0:1788535922.419812:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+19:10457:x1875415589234944:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788535922.419916:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3f7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.419932:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3f7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.419945:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3f7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.419960:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3f83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.419968:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3f83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.419975:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3f83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420385:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3f8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420394:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420408:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535922.420459:0:5834:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420473:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3f7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420479:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3f7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420486:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3f7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420492:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecbe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535922.420496:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3f7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420504:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3f7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420515:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:0.0:1788535922.420518:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535922.420522:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3f7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420529:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3f7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420539:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3f83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420550:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3f83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420565:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3f83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420571:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535922.420574:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3f83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420580:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3f83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420589:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a9a0685f00) 00010000:00010000:0.0:1788535922.420591:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535922.420594:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3f83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420600:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3f83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420615:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420621:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3f8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420627:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3f8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420632:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecba00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535922.420638:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3f8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420645:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3f8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420653:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:0.0:1788535922.420655:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535922.420658:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3f8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.420663:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d3f8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535922.420919:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+19:10457:x1875415589234944:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1106us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535922.420928:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:0.0:1788535922.460576:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535922.460956:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589235200 00000100:00100000:3.0:1788535922.460966:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589235200 00000100:00100000:3.0:1788535922.461031:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:3.0:1788535922.461042:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+19:10460:x1875415589235200:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535922.461063:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535922.461082:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515755 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461147:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3f98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461161:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3f98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461182:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3f98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461197:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3f9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461205:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461211:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461601:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3fa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461610:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461616:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535922.461625:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788535922.461709:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3f98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461716:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3f98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461722:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3f98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461727:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535922.461739:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3f98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461747:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3f98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461948:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:3.0:1788535922.461952:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535922.461957:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3f98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461964:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d3f98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461974:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461979:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3f9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461984:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3f9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461989:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535922.461992:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3f9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.461997:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3f9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.462004:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a997503900) 00010000:00010000:3.0:1788535922.462006:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535922.462014:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3f9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.462982:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d3f9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.463367:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d3f91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515755 expref: 22 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.463387:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515755 expref: 21 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.463395:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503100) 00010000:00010000:2.0:1788535922.463398:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535922.463401:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b800, rc 0) 00000100:00100000:2.0:1788535922.463582:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+21:10460:x1875415589235200:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2540us (3023us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788535922.464669:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:1.0:1788535922.473709:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535922.473746:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589235328 00000100:00100000:1.0:1788535922.473755:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589235328 00000100:00100000:1.0:1788535922.473805:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1788535922.473816:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+21:10460:x1875415589235328:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788535922.473878:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3fb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.473911:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.473923:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.473949:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.473955:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3fb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.473962:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.473967:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535922.473972:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.473986:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3fb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.473997:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503100) 00010000:00010000:1.0:1788535922.474001:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788535922.474005:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3fb4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.474011:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d3fb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535922.474077:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+21:10460:x1875415589235328:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 262us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535922.474084:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:2.0:1788535922.480164:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535922.480265:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589235584 00000100:00100000:1.0:1788535922.480277:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589235584 00000100:00100000:1.0:1788535922.480334:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1788535922.480349:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99c78b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+21:10460:x1875415589235584:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788535922.480611:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99c78b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+22:10460:x1875415589235584:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 263us (455us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788535922.480619:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1788535922.524132:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535922.524168:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589235840 00000100:00100000:0.0:1788535922.524177:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589235840 00000100:00100000:0.0:1788535922.524292:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:0.0:1788535922.524302:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+22:9987:x1875415589235840:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788535922.524324:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535922.524343:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3fbb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751575c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.524433:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.524447:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515755 expref: 23 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.524466:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.524500:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515755 expref: 23 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.524513:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515755 expref: 23 pid: 6697 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535922.524527:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf137100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607080960:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535922.524621:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99250f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788535922.528186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535922.528480:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589235968 00000100:00100000:3.0:1788535922.528489:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589235968 00010000:00010000:3.0:1788535922.528530:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3fa6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515755 expref: 24 pid: 6697 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535922.528581:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1788535922.528591:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+24:2356:x1875415589235968:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535922.528607:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535922.528614:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3fa6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515755 expref: 24 pid: 6697 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.528628:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515755 expref: 24 pid: 6697 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.528652:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503100) 00010000:00010000:3.0:1788535922.528657:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.528666:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.528675:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.528694:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535922.528778:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+24:2356:x1875415589235968:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 187us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535922.528786:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00010000:00010000:0.0:1788535922.529325:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d3fa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515755 expref: 23 pid: 6697 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535922.529341:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf137100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607080960:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535922.529361:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.529369:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.529375:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535922.529394:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788535922.529535:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3fbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751575c expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.529575:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751575c expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.529583:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503100) 00010000:00010000:0.0:1788535922.529586:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788535922.529589:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecbe00, rc 0) 00000100:00100000:0.0:1788535922.529628:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+23:9987:x1875415589235840:12345-192.168.203.12@tcp:101:bash.0 Request processed in 5328us (5515us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788535922.529635:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1788535922.542128:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535922.542551:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589236224 00000100:00100000:2.0:1788535922.542572:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589236224 00000100:00100000:2.0:1788535922.542630:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:2.0:1788535922.542640:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+23:9987:x1875415589236224:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:2.0:1788535922.542878:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.542913:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.542925:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535922.542971:0:6697:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788535922.542994:0:6697:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000006420bbed reply state 0000000006ce95ff transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535922.543003:0:6697:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788535922.543047:0:6697:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788535922.543171:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+27:9987:x1875415589236224:12345-192.168.203.12@tcp:36:bash.0 Request processed in 532us (1051us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788535922.543179:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000020:00080000:2.0:1788535922.543183:0:6697:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788535922.545283:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.545301:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.545308:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.545314:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535922.545319:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.545327:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.545342:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503100) 00010000:00010000:3.0:1788535922.545346:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535922.545351:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.545358:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535922.545687:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535922.546235:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589236352 00000100:00100000:2.0:1788535922.546244:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589236352 00000100:00100000:0.0:1788535922.546366:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:0.0:1788535922.546377:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+26:9987:x1875415589236352:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788535922.546398:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535922.546413:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3fd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515763 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.546468:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3fd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515763 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.546483:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3fd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515763 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.546501:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503100) 00010000:00010000:0.0:1788535922.546504:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788535922.546507:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecb000, rc 0) 00000100:00100000:0.0:1788535922.546576:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+27:9987:x1875415589236352:12345-192.168.203.12@tcp:101:bash.0 Request processed in 201us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535922.546596:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:2.0:1788535922.551312:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535922.551421:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589236480 00000100:00100000:1.0:1788535922.551431:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589236480 00000100:00100000:1.0:1788535922.551498:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1788535922.551508:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:9987:x1875415589236480:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788535922.551526:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535922.551548:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bc6b605/0x74f51638375d3fde lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751576a expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788535922.551584:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ae471, atime: 0x6a9ae46f, ctime: 0x6a9ae471, blocks: 0xb 00010000:00010000:1.0:1788535922.551609:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=324s v=(0 0) 00010000:00010000:1.0:1788535922.551614:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535922.551622:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bc6b605/0x74f51638375d3fde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751576a expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.551639:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006bc6b605/0x74f51638375d3fde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751576a expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.551651:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0be00, rc 0) 00000100:00100000:1.0:1788535922.551714:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+7:9987:x1875415589236480:12345-192.168.203.12@tcp:101:bash.0 Request processed in 207us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535922.551720:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:3.0:1788535922.553811:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535922.554007:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589236608 00000100:00100000:2.0:1788535922.554037:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589236608 00002000:00010000:2.0:1788535922.554073:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788535922.554078:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b61a3100 with x1875415589236608 ext(0->18446744073709551615) 00002000:00010000:2.0:1788535922.554088:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a9b61a3100. 00000100:00100000:2.0:1788535922.554123:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:2.0:1788535922.554132:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2355:x1875415589236608:12345-192.168.203.12@tcp:10:bash.0 00002000:00010000:2.0:1788535922.554426:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788535922.554430:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788535921 -> 1788535922 00002000:00010000:2.0:1788535922.554433:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788535919 -> 1788535919 00002000:00010000:2.0:1788535922.554435:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788535921 -> 1788535922 00002000:00010000:2.0:1788535922.554437:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788535922.554495:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589236608:12345-192.168.203.12@tcp:10:bash.0 Request processed in 364us (693us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788535922.554503:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00002000:00010000:2.0:1788535922.554507:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788535922.554510:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b61a3100 with x1875415589236608 ext(0->18446744073709551615) 00002000:00010000:2.0:1788535922.554514:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a9b61a3100. 00010000:00010000:2.0:1788535922.573986:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535922.645004:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535922.659477:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589236736 00000100:00100000:2.0:1788535922.659492:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589236736 00000100:00100000:2.0:1788535922.659574:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:2.0:1788535922.659584:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+27:10474:x1875415589236736:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1788535922.659652:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3fe5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.659668:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.659695:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.659712:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.659719:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.659725:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.659955:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3ff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.659965:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.659972:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535922.660006:0:5834:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660017:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660024:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3fe5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660031:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660046:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535922.660050:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660057:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3fe5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660069:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:2.0:1788535922.660072:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535922.660077:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3fe5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660082:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d3fe5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660094:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660099:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660104:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660110:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535922.660112:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660119:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660139:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a99742a500) 00010000:00010000:2.0:1788535922.660141:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535922.660145:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660150:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d3fec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660164:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660171:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3ff3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660176:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660181:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ea00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535922.660184:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660188:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3ff3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660194:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503100) 00010000:00010000:2.0:1788535922.660196:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535922.660199:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3ff3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.660204:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3ff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535922.660309:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+27:10474:x1875415589236736:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 724us (15314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535922.660316:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:1.0:1788535922.720090:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535922.720612:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589236992 00000100:00100000:2.0:1788535922.720622:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589236992 00000100:00100000:2.0:1788535922.720681:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:2.0:1788535922.720691:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+27:10477:x1875415589236992:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788535922.720711:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535922.720744:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3ffa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515771 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721110:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4001 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721126:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4001 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721137:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4001 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721151:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4008 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721157:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721163:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721407:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d400f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721417:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d400f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721423:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d400f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535922.721432:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788535922.721514:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4001 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721522:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4001 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721529:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4001 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721535:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535922.721540:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4001 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721547:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4001 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721573:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:2.0:1788535922.721576:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535922.721580:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4001 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721598:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4001 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721612:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721619:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4008 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721625:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4008 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721630:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535922.721633:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4008 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721639:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4008 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721647:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a99742a500) 00010000:00010000:2.0:1788535922.721649:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535922.721652:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4008 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721658:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4008 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721699:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d3ffa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515771 expref: 30 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.721714:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d400f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515771 expref: 29 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.722162:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503100) 00010000:00010000:2.0:1788535922.722165:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788535922.722168:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747ee00, rc 0) 00000100:00100000:3.0:1788535922.726444:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+29:10477:x1875415589236992:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 5742us (6350us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788535922.726457:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:1.0:1788535922.745196:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535922.745408:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589237120 00000100:00100000:2.0:1788535922.745418:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589237120 00000100:00100000:2.0:1788535922.745490:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:2.0:1788535922.745502:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+29:10477:x1875415589237120:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1788535922.745578:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.745597:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751575c expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.745607:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.745641:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751575c expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.745655:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751575c expref: 29 pid: 5834 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535922.745670:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875415607081088:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788535922.745779:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b8d6b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788535922.750804:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535922.750925:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589237376 00000100:00100000:3.0:1788535922.750934:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589237376 00000100:00100000:3.0:1788535922.750990:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788535922.751001:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+30:5592:x1875415589237376:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788535922.751315:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+31:5592:x1875415589237376:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 316us (521us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788535922.751323:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788535922.753487:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875415607081088:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535922.753519:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535922.754984:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535922.757635:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589237504 00000100:00100000:2.0:1788535922.757649:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589237504 00010000:00010000:2.0:1788535922.757699:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751575c expref: 31 pid: 5834 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535922.757751:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1788535922.757770:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+31:2355:x1875415589237504:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535922.757791:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535922.757798:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751575c expref: 31 pid: 5834 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.757812:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751575c expref: 31 pid: 5834 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.757833:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d3fc2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751575c expref: 31 pid: 5834 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.757851:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503100) 00010000:00010000:2.0:1788535922.757856:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.757866:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.757874:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.757960:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535922.758035:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+30:2355:x1875415589237504:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 274us (3057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535922.758042:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00010000:00010000:1.0:1788535922.758106:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.758115:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.758158:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.758165:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.758171:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.758177:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ea00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535922.758181:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.758189:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.758197:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503100) 00010000:00010000:1.0:1788535922.758200:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788535922.758204:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.758210:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d401d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535922.758265:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+29:10477:x1875415589237120:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 12765us (13078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535922.758273:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:0.0:1788535922.761498:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535922.761581:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589237760 00000100:00100000:3.0:1788535922.761591:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589237760 00000100:00100000:3.0:1788535922.761646:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1788535922.761656:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+29:10477:x1875415589237760:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788535922.761913:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+30:10477:x1875415589237760:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 228us (394us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788535922.761923:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1788535922.861704:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535922.861807:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589238016 00000100:00100000:0.0:1788535922.861817:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589238016 00000100:00100000:0.0:1788535922.861878:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:0.0:1788535922.861912:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+30:10488:x1875415589238016:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1788535922.861935:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535922.861955:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d4024 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515778 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862024:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d402b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862039:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d402b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862050:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d402b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862074:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d4032 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862082:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d4032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862090:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d4032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862689:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d4039 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862700:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d4039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862709:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d4039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535922.862720:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788535922.862811:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d402b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862818:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d402b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862825:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d402b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862870:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecbe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535922.862875:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d402b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862883:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d402b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862918:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:0.0:1788535922.862921:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535922.862926:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d402b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862944:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d402b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862957:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d4032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862963:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d4032 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862968:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d4032 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862973:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535922.862976:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d4032 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862982:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d4032 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.862990:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a9a0685e00) 00010000:00010000:0.0:1788535922.862993:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535922.862996:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d4032 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.863003:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d4032 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.863046:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d4024 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515778 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.863073:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d4039 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515778 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535922.863087:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503100) 00010000:00010000:0.0:1788535922.863089:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535922.863092:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987eca200, rc 0) 00000100:00100000:0.0:1788535922.863204:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+32:10488:x1875415589238016:12345-192.168.203.12@tcp:101:cat.0 Request processed in 1317us (1510us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788535922.863212:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:2.0:1788535922.869473:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535922.869611:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589238272 00000100:00100000:3.0:1788535922.869623:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589238272 00000100:00100000:3.0:1788535922.869721:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:3.0:1788535922.869732:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+32:10488:x1875415589238272:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:3.0:1788535922.869994:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+33:10488:x1875415589238272:12345-192.168.203.12@tcp:35:cat.0 Request processed in 264us (529us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788535922.870002:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1788535922.898806:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535922.898993:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589238528 00000100:00100000:3.0:1788535922.899003:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589238528 00000100:00100000:3.0:1788535922.899062:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:3.0:1788535922.899073:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+33:10489:x1875415589238528:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:3.0:1788535922.899144:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788535922.899174:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d4039 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515778 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.899195:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d400f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515771 expref: 32 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.899207:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d3fd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515763 expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.899217:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503100) 00010000:00010000:3.0:1788535922.899228:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535922.899250:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4047 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.899264:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4047 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.899273:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4047 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.899287:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d404e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.899294:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d404e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.899301:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d404e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.899544:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4055 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.899563:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4055 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.899571:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4055 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788535922.900383:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1788535922.900393:0:6697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325031505367ns, next at 326031502948ns, rc = 0 00010000:00010000:3.0:1788535922.900457:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d405c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.900468:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d405c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.900476:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d405c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.900483:0:6697:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d405c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.900488:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d405c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.900495:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d405c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.900522:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788535922.900542:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535922.900545:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4055 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.900549:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d405c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.900570:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4055 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.900973:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4055 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.903207:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535922.903207:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4bc00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788535922.903219:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4055 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.903219:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d405c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.903235:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4055 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.903235:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d405c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.903467:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503900) 00010000:00010000:3.0:1788535922.903471:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788535922.903476:0:6687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97a997503900) 00010000:00010000:3.0:1788535922.903477:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4055 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.903479:0:6687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788535922.903483:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d405c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.903485:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4055 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.903489:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d405c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.903510:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535922.903511:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4047 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.903512:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535922.903515:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535922.903518:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4047 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.903524:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4047 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.903529:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535922.903548:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4047 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.903568:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4047 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.903577:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:3.0:1788535922.903579:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535922.903582:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4047 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.903587:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4047 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535922.903599:0:6697:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000009e5f7307 reply state 00000000f0aa999f transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d404e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535922.903609:0:6697:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535922.903711:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+32:10489:x1875415589238528:12345-192.168.203.12@tcp:36:rm.0 Request processed in 4636us (4911us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788535922.903720:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00010000:00010000:3.0:1788535922.917616:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d404e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.917633:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d404e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.917642:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d404e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.917648:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535922.917653:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d404e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.917676:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d404e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.917694:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a997503e00) 00010000:00010000:3.0:1788535922.917697:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535922.917701:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d404e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.917708:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d404e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535922.957159:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535922.957181:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9ba2c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607081216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535922.957246:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535922.957363:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607081216 00000100:00100000:1.0:1788535922.957371:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607081216 00000100:00100000:1.0:1788535922.957427:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788535922.957435:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875415607081216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535922.957468:0:10342:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535922.957530:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875415607081216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535922.957536:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788535922.957593:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9ba2c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607081216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535922.962720:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535922.963262:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589238784 00000100:00100000:2.0:1788535922.963272:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589238784 00000100:00100000:2.0:1788535922.963338:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:2.0:1788535922.963349:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+31:10495:x1875415589238784:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788535922.963388:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535922.963411:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e200/0x74f51638375d4063 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751577f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.963542:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d406a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.963567:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d406a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.963579:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d406a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.963594:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4071 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.963611:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4071 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.963618:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4071 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788535922.964429:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788535922.964859:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.964871:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.964881:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.965096:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d406a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.965104:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d406a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.965111:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d406a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.965116:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ee00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535922.965120:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d406a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.965128:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d406a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.965138:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:2.0:1788535922.965141:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535922.965149:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d406a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.965155:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d406a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535922.965167:0:5833:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000087777598 reply state 00000000db8175f6 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4071 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535922.965175:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788535922.965203:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e200/0x74f51638375d4063 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751577f expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.965228:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751577f expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535922.965235:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:2.0:1788535922.965237:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535922.965239:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747f000, rc 0) 00000100:00100000:2.0:1788535922.965359:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+34:10495:x1875415589238784:12345-192.168.203.12@tcp:101:bash.0 Request processed in 2011us (2648us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788535922.965367:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00010000:00010000:1.0:1788535922.969508:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4071 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.969528:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4071 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.969536:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4071 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.969581:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535922.969587:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4071 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.969595:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4071 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.969622:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a99742a500) 00010000:00010000:1.0:1788535922.969626:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535922.969631:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4071 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535922.969637:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4071 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535922.977486:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535922.977783:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589238912 00000100:00100000:3.0:1788535922.977794:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589238912 00000100:00100000:3.0:1788535922.977849:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1788535922.977858:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2356:x1875415589238912:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788535922.977873:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535922.977909:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4086 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515786 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788535922.977934:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788535922.977953:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=325s v=(0 0) 00010000:00010000:3.0:1788535922.977959:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535922.977967:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4086 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515786 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.978001:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4086 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515786 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.978013:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4a200, rc 0) 00000100:00100000:3.0:1788535922.978341:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:2356:x1875415589238912:12345-192.168.203.12@tcp:101:bash.0 Request processed in 482us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535922.978348:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1788535922.988478:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535922.988783:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589239040 00000100:00100000:3.0:1788535922.988793:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589239040 00000100:00100000:3.0:1788535922.989219:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:3.0:1788535922.989230:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+8:10495:x1875415589239040:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788535922.989247:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535922.989265:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751578d expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.989296:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4086 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515786 expref: 9 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.989305:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535922.989309:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535922.989314:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.989350:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4086 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515786 expref: 9 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535922.989379:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4086 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515786 expref: 9 pid: 6673 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535922.989394:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7054a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8424:1875415607081344:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535922.990534:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b668b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788535923.001752:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7054a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8424:1875415607081344:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788535923.001792:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.001815:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4a600, rc 0) 00000100:00100000:3.0:1788535923.002150:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+9:10495:x1875415589239040:12345-192.168.203.12@tcp:101:bash.0 Request processed in 12919us (13687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535923.002160:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1788535923.008499:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535923.010357:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589239168 00000100:00100000:2.0:1788535923.010371:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589239168 00010000:00010000:2.0:1788535923.010439:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4086 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515786 expref: 9 pid: 6673 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535923.010482:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1788535923.010503:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987ece850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+9:2355:x1875415589239168:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535923.010518:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535923.010543:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4086 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515786 expref: 9 pid: 6673 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.010568:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4086 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515786 expref: 9 pid: 6673 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.010591:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4086 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515786 expref: 9 pid: 6673 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.010638:0:7598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535923.010642:0:7598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535923.010650:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.010661:0:7598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.010712:0:7598:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535923.010726:0:7598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7598:1875415607081472:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788535923.010818:0:7598:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b8d6b780 going to sleep for 11 seconds 00000100:00080000:0.0:1788535923.013157:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535923.021275:0:7598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7598:1875415607081472:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788535923.021310:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535923.021417:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987ece850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589239168:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 10916us (12926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535923.021428:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1788535923.036500:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535923.039475:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589239424 00000100:00100000:0.0:1788535923.041616:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589239424 00000100:00100000:0.0:1788535923.042039:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:0.0:1788535923.042054:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+33:10495:x1875415589239424:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:0.0:1788535923.042443:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+34:10495:x1875415589239424:12345-192.168.203.12@tcp:35:bash.0 Request processed in 391us (5964us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788535923.042452:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00080000:2.0:1788535923.042525:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535923.236732:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535923.236975:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589239552 00000100:00100000:0.0:1788535923.236985:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589239552 00000100:00100000:0.0:1788535923.237056:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:0.0:1788535923.237068:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+34:10511:x1875415589239552:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535923.237106:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535923.237127:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d4094 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515794 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.237188:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d409b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.237203:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d409b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.237214:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d409b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535923.237244:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788535923.237248:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535923.237264:0:5834:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d409b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.237287:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d4094 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515794 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.237304:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d409b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515794 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.237312:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:0.0:1788535923.237315:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788535923.237319:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecbe00, rc 0) 00000100:00100000:0.0:1788535923.237524:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+35:10511:x1875415589239552:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 458us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535923.237531:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:1.0:1788535923.243326:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535923.243416:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589239808 00000100:00100000:3.0:1788535923.243426:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589239808 00000100:00100000:3.0:1788535923.243484:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:3.0:1788535923.243495:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+35:10511:x1875415589239808:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535923.243514:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535923.243534:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d40a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751579b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.243662:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d40a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.243685:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d40a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.243696:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d40a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535923.243708:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788535923.243844:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d40a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751579b expref: 38 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.243861:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d40a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751579b expref: 37 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.243870:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:3.0:1788535923.243872:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535923.243876:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4ac00, rc 0) 00000100:00100000:3.0:1788535923.243981:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+37:10511:x1875415589239808:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 487us (664us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788535923.243988:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:2.0:1788535923.248489:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535923.248593:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589240192 00000100:00100000:1.0:1788535923.248604:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589240192 00000100:00100000:1.0:1788535923.248668:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788535923.248678:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+37:2355:x1875415589240192:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535923.248693:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535923.248717:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d40a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751579b expref: 37 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.248748:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:1.0:1788535923.248753:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535923.248819:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+36:2355:x1875415589240192:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 142us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535923.248834:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788535923.251075:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535923.251149:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589240064 00000100:00100000:1.0:1788535923.251158:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589240064 00000100:00100000:1.0:1788535923.251210:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:1.0:1788535923.251220:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+36:10511:x1875415589240064:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788535923.251241:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535923.251260:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d40b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157a2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.251348:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.251377:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.251388:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535923.251401:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788535923.251521:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d40b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157a2 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.251538:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157a2 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.251548:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:1.0:1788535923.251563:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788535923.251567:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a400, rc 0) 00000100:00100000:1.0:1788535923.251626:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+38:10511:x1875415589240064:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 407us (560us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788535923.251633:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:2.0:1788535923.264007:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535923.264148:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589240320 00000100:00100000:1.0:1788535923.264157:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589240320 00000100:00100000:1.0:1788535923.264211:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:1.0:1788535923.264220:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+8:2356:x1875415589240320:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:1.0:1788535923.264259:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.264278:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.264299:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535923.264304:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535923.264309:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.264343:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.264356:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 8 pid: 8424 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535923.264370:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9ba2c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6674:1875415607081600:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788535923.264454:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980ccd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535923.266923:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9ba2c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6674:1875415607081600:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535923.266953:0:6674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535923.268726:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535923.268854:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589240448 00000100:00100000:3.0:1788535923.268864:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589240448 00002000:00100000:3.0:1788535923.268945:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97a9b61af480 x1875415589240448/t0(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:579/0 lens 504/0 e 0 to 0 dl 1788535934 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788535923.268956:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b61af480 with x1875415589240448 ext(0->8) 00010000:00010000:3.0:1788535923.268965:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 9 pid: 8424 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.269003:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 9 pid: 8424 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788535923.269012:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97a9b61af480 00000100:00100000:3.0:1788535923.269055:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1788535923.269065:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:30a1922d-0d3f-4681-a966-cec3672631c6+9:2356:x1875415589240448:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:3.0:1788535923.269531:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:30a1922d-0d3f-4681-a966-cec3672631c6+11:2356:x1875415589240448:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 465us (811us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788535923.269540:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00002000:00100000:3.0:1788535923.269547:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97a9b61af480 x1875415589240448/t4294967302(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:579/0 lens 504/448 e 0 to 0 dl 1788535934 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788535923.269568:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b61af480 with x1875415589240448 ext(0->8) 00010000:00010000:3.0:1788535923.269575:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 11 pid: 8424 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.269587:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 11 pid: 8424 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788535923.269595:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97a9b61af480 00000100:00100000:2.0:1788535923.273414:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535923.273501:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589240576 00000100:00100000:3.0:1788535923.273510:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589240576 00010000:00010000:3.0:1788535923.273560:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 11 pid: 8424 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535923.273621:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:3.0:1788535923.273632:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+11:2356:x1875415589240576:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535923.273645:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788535923.273663:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788535923.273666:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788535923 00002000:00010000:3.0:1788535923.273668:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788535923 00002000:00010000:3.0:1788535923.273671:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788535923 00010000:00010000:3.0:1788535923.273677:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 11 pid: 8424 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.273691:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 11 pid: 8424 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.273711:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d408d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751578d expref: 11 pid: 8424 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.273740:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535923.273744:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535923.273751:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.273759:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.274139:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535923.274206:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+10:2356:x1875415589240576:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 574us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535923.274214:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00010000:00010000:1.0:1788535923.275411:0:6674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.275427:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.275546:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.275605:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.275613:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.275620:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a800 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788535923.275624:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.275633:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.275650:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.275658:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076b694bd/0x74f51638375d40cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535923.276118:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+9:2356:x1875415589240320:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 11892us (12112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535923.276128:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:2.0:1788535923.279697:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535923.280126:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589240832 00000100:00100000:3.0:1788535923.280137:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589240832 00000100:00100000:3.0:1788535923.280248:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:3.0:1788535923.280259:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99c78a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+38:10511:x1875415589240832:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:3.0:1788535923.280326:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157a2 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535923.280582:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788535923.280631:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788535923.281003:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788535923.281227:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.281243:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4078 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751577f expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.281253:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.281288:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751577f expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.281305:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4078 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751577f expref: 42 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535923.281320:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7054a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875415607081728:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535923.281419:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b668b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535923.285263:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535923.285371:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7054a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875415607081728:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535923.285399:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535923.291174:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589240960 00000100:00100000:1.0:1788535923.291208:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589240960 00010000:00010000:1.0:1788535923.291255:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4078 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751577f expref: 43 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535923.291344:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1788535923.291354:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+43:2356:x1875415589240960:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535923.291370:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535923.291379:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4078 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751577f expref: 43 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.291393:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751577f expref: 43 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.291415:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4078 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751577f expref: 43 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.291433:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:1.0:1788535923.291439:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.291449:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.291457:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.291495:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535923.291571:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+42:2356:x1875415589240960:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 217us (6317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535923.291588:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00010000:00010000:0.0:1788535923.291639:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.291658:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788535923.291801:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788535923.292057:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788535923.292193:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf135c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607081856:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788535923.292256:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535923.292287:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987964780 going to sleep for 11 seconds 00000100:00100000:0.0:1788535923.292316:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607081856 00000100:00100000:0.0:1788535923.292321:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607081856 00000100:00100000:0.0:1788535923.292365:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788535923.292372:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875415607081856:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788535923.292441:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875415607081856:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 69us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535923.292448:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788535923.292468:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535923.292501:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf135c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607081856:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788535923.292958:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788535923.293014:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61a2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607081984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788535923.293044:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535923.293061:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a992036e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535923.293076:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607081984 00000100:00100000:0.0:1788535923.293080:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607081984 00000100:00100000:0.0:1788535923.293104:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788535923.293111:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875415607081984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788535923.293232:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5836:x1875415607081984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 121us (186us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788535923.293244:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788535923.293279:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61a2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607081984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788535923.293317:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788535923.293351:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.293361:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.293370:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.293376:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535923.293381:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.293390:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.293403:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:0.0:1788535923.293406:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788535923.293410:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.293416:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d40d3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788535923.293580:0:5836:0:(mdd_object.c:4338:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788535923.293675:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1788535923.293687:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325424799210ns, next at 326424796171ns, rc = 0 00000001:00080000:0.0:1788535923.293701:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788535923.293732:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:0.0:1788535923.293735:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788535923.293742:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157a2 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535923.293820:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99c78a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+45:10511:x1875415589240832:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 13562us (14133us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788535923.293828:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000020:00080000:0.0:1788535923.293832:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788535923.299518:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535923.299786:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589241088 00000100:00100000:0.0:1788535923.299796:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589241088 00000100:00100000:0.0:1788535923.299861:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:0.0:1788535923.299873:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+45:10511:x1875415589241088:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535923.299919:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535923.299941:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d40da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.300002:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d40da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157a9 expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.300131:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d40da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157a9 expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.300156:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:0.0:1788535923.300160:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788535923.300163:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecb400, rc 0) 00000100:00100000:0.0:1788535923.300224:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+46:10511:x1875415589241088:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 353us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535923.300239:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:0.0:1788535923.305731:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535923.305910:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589241344 00000100:00100000:1.0:1788535923.305921:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589241344 00000100:00100000:1.0:1788535923.305974:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1788535923.305984:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+46:10511:x1875415589241344:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788535923.306215:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+47:10511:x1875415589241344:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 232us (494us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788535923.306222:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1788535923.406134:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535923.406250:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589241472 00000100:00100000:0.0:1788535923.406261:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589241472 00000100:00100000:0.0:1788535923.406349:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:0.0:1788535923.406360:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+47:10521:x1875415589241472:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788535923.406438:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d40e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406455:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d40e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406467:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d40e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406482:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d40e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406489:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d40e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406495:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d40e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406594:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d40ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406602:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d40ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406609:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d40ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535923.406657:0:5832:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d40ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406670:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d40e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406676:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d40e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406682:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d40e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406687:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecba00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535923.406691:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d40e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406699:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d40e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406709:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:0.0:1788535923.406712:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535923.406716:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d40e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406722:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d40e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406747:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d40e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406753:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d40e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406765:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d40e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406779:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535923.406782:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d40e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406789:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d40e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406796:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a9a0685f00) 00010000:00010000:0.0:1788535923.406799:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535923.406802:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d40e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406807:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d40e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406821:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d40ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406837:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d40ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406844:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d40ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406849:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecae00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535923.406851:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d40ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406867:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d40ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406875:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:0.0:1788535923.406877:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535923.406880:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d40ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.406933:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d40ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535923.407010:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+47:10521:x1875415589241472:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 651us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535923.407017:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:3.0:1788535923.442265:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535923.442378:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589241728 00000100:00100000:1.0:1788535923.442389:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589241728 00000100:00100000:1.0:1788535923.442455:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:1.0:1788535923.442466:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+47:10524:x1875415589241728:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788535923.442487:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535923.442507:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d40f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157b0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.442592:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.442607:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.442619:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.442633:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4104 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.442654:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.442661:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.442785:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d410b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.442793:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d410b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.442800:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d410b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535923.442808:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788535923.442951:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.442959:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.442966:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.442971:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535923.442975:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.442982:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.443005:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:1.0:1788535923.443008:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535923.443013:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.443787:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d40fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.443805:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.443811:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4104 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.443818:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4104 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.443823:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ae00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535923.443827:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4104 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.443833:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4104 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.443844:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a9888add00) 00010000:00010000:1.0:1788535923.443846:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535923.443849:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4104 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.443855:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4104 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.444005:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d40f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157b0 expref: 50 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.444239:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d410b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157b0 expref: 49 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.444248:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:1.0:1788535923.444250:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535923.444253:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a800, rc 0) 00000100:00100000:1.0:1788535923.444374:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+49:10524:x1875415589241728:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1908us (2116us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788535923.444383:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:3.0:1788535923.449470:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535923.449588:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589241856 00000100:00100000:0.0:1788535923.449600:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589241856 00000100:00100000:0.0:1788535923.449708:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:0.0:1788535923.449718:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+49:10524:x1875415589241856:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788535923.449829:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d4119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.449851:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d4119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.449863:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d4119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.449927:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d4119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.449963:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d4119 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.449970:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d4119 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.449976:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecae00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535923.449981:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d4119 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.449989:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d4119 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.450003:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:0.0:1788535923.450005:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788535923.450010:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d4119 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.450029:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d4119 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535923.450241:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+49:10524:x1875415589241856:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 392us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535923.450252:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:3.0:1788535923.453399:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535923.453619:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589242112 00000100:00100000:1.0:1788535923.453630:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589242112 00000100:00100000:1.0:1788535923.453687:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:1.0:1788535923.453697:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+49:10524:x1875415589242112:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788535923.454133:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+50:10524:x1875415589242112:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 435us (742us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788535923.454143:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:3.0:1788535923.555253:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535923.555583:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589242368 00000100:00100000:0.0:1788535923.555593:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589242368 00000100:00100000:0.0:1788535923.555707:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:0.0:1788535923.555719:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+50:10534:x1875415589242368:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788535923.555759:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535923.555774:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788535923.555803:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d409b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515794 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.555823:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:0.0:1788535923.555828:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788535923.555853:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d4120 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157b7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.556001:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4127 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.556339:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.556353:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535923.556366:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788535923.556581:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d4120 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157b7 expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.556598:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157b7 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.556605:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:0.0:1788535923.556608:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535923.556611:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987eca000, rc 0) 00000100:00100000:0.0:1788535923.556684:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+51:10534:x1875415589242368:12345-192.168.203.12@tcp:101:bash.0 Request processed in 966us (1439us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788535923.556705:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:3.0:1788535923.560977:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535923.561086:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535923.561208:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589242752 00000100:00100000:1.0:1788535923.561218:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589242752 00000100:00100000:1.0:1788535923.561271:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:1.0:1788535923.561281:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+51:10534:x1875415589242752:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:1.0:1788535923.561333:0:11644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535923.561359:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d410b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157b0 expref: 51 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.561406:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:1.0:1788535923.561411:0:11644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535923.561622:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.561637:0:11644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4127 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157b7 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.561646:0:11644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.561677:0:11644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157b7 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.561690:0:11644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4127 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157b7 expref: 51 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535923.561704:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9ba2c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607082112:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788535923.561787:0:11644:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788535923.562667:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589242496 00000100:00100000:2.0:1788535923.562677:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589242496 00010000:00010000:2.0:1788535923.562711:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4127 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157b7 expref: 52 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535923.562763:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1788535923.562773:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+52:2355:x1875415589242496:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535923.562783:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535923.562790:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4127 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157b7 expref: 52 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.562802:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4127 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157b7 expref: 52 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.562818:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:2.0:1788535923.562834:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.562843:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.562850:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.562867:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535923.562942:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+52:2355:x1875415589242496:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 171us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535923.562950:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00010000:00010000:3.0:1788535923.571099:0:11644:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.12@tcp) returned -22 from blocking AST (req@00000000da63b720 x1875415607082112) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4127 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157b7 expref: 51 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.571137:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4127 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157b7 expref: 51 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535923.571154:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9ba2c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607082112:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788535923.571179:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535923.571188:0:11644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.571197:0:11644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.571203:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535923.571331:0:11644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1788535923.571393:0:11644:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000023cd4217 reply state 0000000011c681cf transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535923.571419:0:11644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535923.571542:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+52:10534:x1875415589242752:12345-192.168.203.12@tcp:36:bash.0 Request processed in 10262us (10455us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788535923.571563:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00000020:00080000:3.0:1788535923.571569:0:11644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788535923.574749:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.574768:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.574777:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.574783:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ac00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535923.574789:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.574797:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.574816:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535923.574820:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535923.574824:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.574831:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4135 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535923.582536:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535923.583566:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589242880 00000100:00100000:0.0:1788535923.583579:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589242880 00000100:00100000:0.0:1788535923.583702:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:0.0:1788535923.583714:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+51:10534:x1875415589242880:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788535923.583752:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535923.583773:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d413c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157be expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.583919:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4143 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.583935:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.583946:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535923.583973:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788535923.583978:0:6697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535923.583995:0:6697:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.584031:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d413c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157be expref: 53 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.584048:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157be expref: 52 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.584068:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:0.0:1788535923.584071:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535923.584074:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecba00, rc 0) 00000100:00100000:0.0:1788535923.584504:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+52:10534:x1875415589242880:12345-192.168.203.12@tcp:101:bash.0 Request processed in 789us (1973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535923.584513:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:1.0:1788535923.587216:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535923.587390:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589243136 00000100:00100000:3.0:1788535923.587414:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589243136 00000100:00100000:3.0:1788535923.587473:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:3.0:1788535923.587483:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+52:10534:x1875415589243136:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:3.0:1788535923.587713:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+53:10534:x1875415589243136:12345-192.168.203.12@tcp:35:bash.0 Request processed in 231us (508us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788535923.587721:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00010000:00010000:3.0:1788535923.598398:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535923.654638:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535923.655270:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589243264 00000100:00100000:1.0:1788535923.655282:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589243264 00000100:00100000:1.0:1788535923.655398:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:1.0:1788535923.655408:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+53:10540:x1875415589243264:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788535923.655433:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535923.655468:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d414a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157c5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.655529:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4151 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.655541:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.655564:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535923.655598:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788535923.655602:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535923.655619:0:5833:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.655641:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d414a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157c5 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.655660:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157c5 expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.655668:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:1.0:1788535923.655671:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535923.655674:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0aa00, rc 0) 00000100:00100000:1.0:1788535923.656049:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+54:10540:x1875415589243264:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 640us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535923.656056:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:2.0:1788535923.658983:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535923.659274:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589243392 00000100:00100000:3.0:1788535923.659284:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589243392 00000100:00100000:3.0:1788535923.659345:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:3.0:1788535923.659355:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+54:10540:x1875415589243392:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535923.659373:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535923.659404:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4158 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157cc expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659466:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d415f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659481:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d415f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659492:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d415f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659505:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d4166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659511:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d4166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659525:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d4166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659625:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659635:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659642:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535923.659675:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788535923.659679:0:11644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788535923.659697:0:11644:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659708:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659717:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d415f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659928:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d415f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659937:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d415f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659943:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535923.659948:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d415f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659964:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d415f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659976:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:3.0:1788535923.659979:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535923.659984:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d415f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.659990:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d415f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.660003:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d4166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.660010:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d4166 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.660084:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d4166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.660089:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4ac00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535923.660092:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d4166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.660099:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d4166 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.660177:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a997503600) 00010000:00010000:3.0:1788535923.660180:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535923.660185:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d4166 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.660200:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d4166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.660235:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4158 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157cc expref: 56 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.660248:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157cc expref: 55 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.660255:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535923.660258:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535923.660260:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4a200, rc 0) 00000100:00100000:3.0:1788535923.660322:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+55:10540:x1875415589243392:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 968us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535923.660331:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:3.0:1788535923.663546:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535923.663780:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589243648 00000100:00100000:0.0:1788535923.663789:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589243648 00000100:00100000:0.0:1788535923.663857:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:0.0:1788535923.663870:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a98366b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+55:10540:x1875415589243648:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535923.663923:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535923.663945:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d4174 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157d3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.664049:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.664063:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4143 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157be expref: 56 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.664071:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157cc expref: 56 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.664079:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.664254:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157cc expref: 56 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.664277:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157cc expref: 56 pid: 11644 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535923.664292:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b74d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6697:1875415607082240:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535923.664449:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157be expref: 56 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.664459:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4143 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157be expref: 56 pid: 6697 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535923.664468:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6697:1875415607082368:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535923.664494:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a992036e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788535923.673735:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535923.673814:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589243776 00000100:00100000:3.0:1788535923.673823:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589243776 00010000:00010000:3.0:1788535923.673873:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157cc expref: 57 pid: 11644 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535923.673944:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788535923.673954:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+57:2356:x1875415589243776:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535923.673967:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535923.673973:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157cc expref: 57 pid: 11644 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.674002:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157cc expref: 57 pid: 11644 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.674033:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535923.674038:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.674046:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.674051:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535923.674098:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+57:2356:x1875415589243776:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 145us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535923.674104:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788535923.676089:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535923.676268:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589243904 00000100:00100000:2.0:1788535923.676277:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589243904 00010000:00010000:2.0:1788535923.676315:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4143 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157be expref: 57 pid: 6697 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535923.676352:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:2.0:1788535923.676361:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983669c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+57:2355:x1875415589243904:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535923.676374:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535923.676391:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4143 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157be expref: 57 pid: 6697 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.676404:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4143 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157be expref: 57 pid: 6697 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.676425:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:2.0:1788535923.676431:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.676440:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.676448:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.676466:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535923.676523:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983669c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+57:2355:x1875415589243904:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 163us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535923.676530:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00010000:00010000:0.0:1788535923.677232:0:6697:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.12@tcp) returned -22 from blocking AST (req@000000001440303f x1875415607082240) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157cc expref: 56 pid: 11644 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.677250:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d416d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157cc expref: 56 pid: 11644 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535923.677267:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b74d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6697:1875415607082240:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535923.677288:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4143 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157be expref: 55 pid: 6697 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535923.677298:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6697:1875415607082368:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535923.677329:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:0.0:1788535923.677335:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.677344:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.677349:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535923.677368:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788535923.677854:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d4174 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157d3 expref: 56 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.677872:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157d3 expref: 55 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535923.677880:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:0.0:1788535923.677883:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788535923.677934:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecb800, rc 0) 00000100:00100000:0.0:1788535923.677987:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a98366b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+55:10540:x1875415589243648:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 14120us (14449us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788535923.677995:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:3.0:1788535923.680711:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535923.680822:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589244160 00000100:00100000:1.0:1788535923.680844:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589244160 00000100:00100000:1.0:1788535923.680940:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788535923.680951:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+55:10540:x1875415589244160:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:1.0:1788535923.680967:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535923.680992:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d40da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157a9 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535923.681011:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:1.0:1788535923.681017:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535923.681082:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+54:10540:x1875415589244160:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 132us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535923.681088:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788535923.683942:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535923.684233:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589244288 00000100:00100000:3.0:1788535923.684242:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589244288 00000100:00100000:3.0:1788535923.684292:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:3.0:1788535923.684303:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+54:10540:x1875415589244288:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:3.0:1788535923.684690:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4189 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.684708:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4189 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535923.684719:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4189 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788535923.685321:0:11644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788535923.685659:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+54:10540:x1875415589244288:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 1353us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535923.685670:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:3.0:1788535923.688292:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535923.688555:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589244416 00000100:00100000:2.0:1788535923.688565:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589244416 00000100:00100000:2.0:1788535923.688648:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 111 00000100:00100000:2.0:1788535923.688658:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a98366b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+54:10540:x1875415589244416:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788535923.688677:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535923.688695:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e200/0x74f51638375d4190 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157da expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.688758:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4189 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.688769:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e200/0x74f51638375d4190 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157da expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.688786:0:5832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4189 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.688799:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e200/0x74f51638375d4190 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157da expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.688813:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:2.0:1788535923.688815:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788535923.688818:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e200/0x74f51638375d4190 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157da expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535923.688825:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747e200, rc 0) 00000100:00100000:2.0:1788535923.688916:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a98366b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+55:10540:x1875415589244416:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 259us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535923.688923:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 111 00000040:00080000:1.0:1788535923.981831:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788535923.981841:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788535923.981910:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788535923.981917:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788535923.982051:0:11640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9ba2c0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11640:1875415607082496:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788535923.982149:0:11640:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9980cc300 going to sleep for 11 seconds 00000100:00100000:3.0:1788535923.987791:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535923.987950:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589244544 00000100:00100000:1.0:1788535923.987961:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589244544 00000100:00100000:1.0:1788535923.988026:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:1.0:1788535923.988036:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a98366aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+56:10541:x1875415589244544:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788535923.988066:0:6697:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788535923.988195:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a98366aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+56:10541:x1875415589244544:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 160us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535923.988202:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:0.0:1788535924.000271:0:11640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9ba2c0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11640:1875415607082496:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788535924.005247:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535924.005343:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589244672 00000100:00100000:3.0:1788535924.005353:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589244672 00000100:00100000:3.0:1788535924.005416:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:3.0:1788535924.005427:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+55:10541:x1875415589244672:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788535924.005510:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4197 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.005528:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4197 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.005543:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4197 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.005616:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d419e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.005624:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d419e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.005631:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d419e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.005654:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d41a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.005675:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d41a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.005682:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d41a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535924.006283:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788535924.006290:0:11644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788535924.006305:0:11644:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d41a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006318:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4197 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006325:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4197 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006332:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4197 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006337:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535924.006341:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4197 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006348:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4197 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006359:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a99742a400) 00010000:00010000:3.0:1788535924.006362:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535924.006367:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4197 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006387:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4197 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006401:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d419e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006407:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d419e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006413:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d419e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006418:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4ac00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535924.006421:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d419e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006428:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d419e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006436:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff97a997503600) 00010000:00010000:3.0:1788535924.006438:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535924.006441:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d419e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006447:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d419e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006462:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d41a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006468:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d41a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006482:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d41a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006488:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535924.006490:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d41a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006496:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d41a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006504:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535924.006507:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535924.006510:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d41a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.006516:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d41a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535924.006620:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+55:10541:x1875415589244672:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 1191us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535924.006629:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:3.0:1788535924.010037:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535924.010321:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589244928 00000100:00100000:2.0:1788535924.010332:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589244928 00000100:00100000:2.0:1788535924.010399:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:2.0:1788535924.010410:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+55:10541:x1875415589244928:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535924.010431:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535924.010452:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d41ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157e1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.010544:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d41b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.010568:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d41b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.010580:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d41b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535924.010591:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788535924.010684:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d41b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.010692:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d41b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.010698:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d41b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.010703:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ee00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535924.010708:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d41b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.010715:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d41b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.010740:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:2.0:1788535924.010744:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788535924.010749:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d41b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.010756:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d41b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.010796:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d41ac lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157e1 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.010806:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a99742a400) 00010000:00010000:2.0:1788535924.010809:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788535924.010812:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d41ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157e1 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.010820:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747e600, rc 0) 00000100:00100000:2.0:1788535924.010880:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+56:10541:x1875415589244928:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 472us (852us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788535924.010918:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:0.0:1788535924.014921:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535924.015026:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589245056 00000100:00100000:2.0:1788535924.015035:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589245056 00000100:00100000:2.0:1788535924.015092:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:2.0:1788535924.015102:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+56:10541:x1875415589245056:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788535924.015162:0:5834:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788535924.015260:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+56:10541:x1875415589245056:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 158us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535924.015277:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:3.0:1788535924.019195:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535924.019328:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589245312 00000100:00100000:1.0:1788535924.019338:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589245312 00000100:00100000:1.0:1788535924.019400:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:1.0:1788535924.019411:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+56:10541:x1875415589245312:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788535924.019432:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535924.019435:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788535924.019462:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4151 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157c5 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.019481:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:1.0:1788535924.019485:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535924.019498:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d41c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788535924.020409:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788535924.020623:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d41c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.020638:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d41c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.020648:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d41c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.020718:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d41c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157e8 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.020744:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d41c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157e8 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.020758:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a9888add00) 00010000:00010000:1.0:1788535924.020761:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535924.020763:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0b400, rc 0) 00000100:00100000:1.0:1788535924.020821:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+57:10541:x1875415589245312:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1411us (1636us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788535924.020830:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:0.0:1788535924.025439:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535924.025880:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589245568 00000100:00100000:1.0:1788535924.025918:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589245568 00000100:00100000:1.0:1788535924.025979:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:1.0:1788535924.025989:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+57:10541:x1875415589245568:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788535924.026073:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535924.026104:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d41c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157e8 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026125:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a9888add00) 00010000:00010000:1.0:1788535924.026138:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535924.026164:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d41d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026180:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d41d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026190:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d41d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026208:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d41dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa6262c47 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026237:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d41dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6262c47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026244:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d41dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6262c47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026311:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d41d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026318:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d41d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026324:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d41d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026329:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535924.026334:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d41d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026342:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d41d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026350:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:1.0:1788535924.026353:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535924.026357:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d41d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026363:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d41d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026371:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d41dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6262c47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026385:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d41dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6262c47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026390:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d41dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6262c47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026395:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535924.026398:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d41dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6262c47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026403:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d41dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6262c47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026411:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa6262c47 (ffff97a9888ada00) 00010000:00010000:1.0:1788535924.026414:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535924.026417:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d41dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa6262c47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.026422:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d41dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa6262c47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535924.026499:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+56:10541:x1875415589245568:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 511us (1071us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788535924.026507:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:0.0:1788535924.029322:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535924.030444:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589245696 00000100:00100000:3.0:1788535924.030456:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589245696 00000100:00100000:3.0:1788535924.030521:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:3.0:1788535924.030539:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+56:10541:x1875415589245696:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535924.030566:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535924.030605:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d41e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157ef expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.030641:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d41eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.030654:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d41eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.030665:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d41eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.030751:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d41e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157ef expref: 58 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.030770:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d41eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157ef expref: 57 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.030778:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a997503600) 00010000:00010000:3.0:1788535924.030782:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788535924.030785:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4ac00, rc 0) 00000100:00100000:3.0:1788535924.030861:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+57:10541:x1875415589245696:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 332us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535924.030868:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:0.0:1788535924.036114:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535924.036210:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589245952 00000100:00100000:1.0:1788535924.036220:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589245952 00000100:00100000:1.0:1788535924.036281:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:1.0:1788535924.036290:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+57:10541:x1875415589245952:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788535924.036369:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d41f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.036393:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d41f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.036407:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d41f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788535924.036700:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1788535924.036710:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 326167822202ns, next at 327167819461ns, rc = 0 00000004:00010000:1.0:1788535924.036802:0:5833:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000005c184540 reply state 0000000054e050a6 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d41f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535924.036813:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535924.036953:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+59:10541:x1875415589245952:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 663us (851us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788535924.036961:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00010000:00010000:3.0:1788535924.041615:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d41f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.041635:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d41f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.041642:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d41f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.041663:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ba00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535924.041668:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d41f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.041675:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d41f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.041702:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a997503600) 00010000:00010000:3.0:1788535924.041705:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788535924.041710:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d41f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.041717:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d41f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535924.044044:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535924.044147:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589246080 00000100:00100000:3.0:1788535924.044158:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589246080 00000100:00100000:3.0:1788535924.044226:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:3.0:1788535924.044236:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+58:10541:x1875415589246080:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535924.044259:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535924.044280:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d41f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157f6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.044339:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d41f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157f6 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.044354:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d41f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157f6 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.044383:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a997503600) 00010000:00010000:3.0:1788535924.044386:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788535924.044390:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b600, rc 0) 00000100:00100000:3.0:1788535924.044451:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+59:10541:x1875415589246080:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 206us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535924.044459:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:1.0:1788535924.052136:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535924.052275:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589246208 00000100:00100000:3.0:1788535924.052286:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589246208 00000100:00100000:3.0:1788535924.052360:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:3.0:1788535924.052370:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589246208:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788535924.052670:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+9:2355:x1875415589246208:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 301us (543us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788535924.052678:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00080000:0.0:1788535924.054002:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788535924.056991:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535924.057129:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589246464 00000100:00100000:3.0:1788535924.057139:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589246464 00000100:00100000:3.0:1788535924.057187:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:3.0:1788535924.057196:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+59:10541:x1875415589246464:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788535924.057427:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+60:10541:x1875415589246464:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 232us (445us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788535924.057435:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:1.0:1788535924.059410:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535924.059496:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589246720 00000100:00100000:0.0:1788535924.059506:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589246720 00000100:00100000:0.0:1788535924.059566:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:0.0:1788535924.059576:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+60:10541:x1875415589246720:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788535924.059736:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+60:10541:x1875415589246720:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 152us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535924.059743:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:0.0:1788535924.063387:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535924.063509:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589246848 00000100:00100000:1.0:1788535924.063519:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589246848 00000100:00100000:1.0:1788535924.063621:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:1.0:1788535924.063631:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+60:10541:x1875415589246848:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788535924.063650:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535924.063672:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4200 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975157fd expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.063949:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4207 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.063982:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.063996:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535924.064148:0:6697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535924.064166:0:6697:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.064192:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4200 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157fd expref: 62 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.064211:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157fd expref: 61 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.064220:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a997503600) 00010000:00010000:1.0:1788535924.064223:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788535924.064226:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0b400, rc 0) 00000100:00100000:1.0:1788535924.064331:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+61:10541:x1875415589246848:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 700us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535924.064339:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:2.0:1788535924.068477:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535924.068583:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589246976 00000100:00100000:3.0:1788535924.068594:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589246976 00000100:00100000:3.0:1788535924.068683:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:3.0:1788535924.068702:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+9:2355:x1875415589246976:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535924.068735:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535924.068755:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d420e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515804 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788535924.068782:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ae474, blocks: 0x1 00010000:00010000:3.0:1788535924.068803:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1788535924.068807:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535924.068816:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d420e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515804 expref: 10 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.068848:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d420e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515804 expref: 10 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.068862:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4a600, rc 0) 00000100:00100000:3.0:1788535924.068950:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+10:2355:x1875415589246976:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 249us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535924.068958:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788535924.072734:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535924.072830:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589247232 00000100:00100000:1.0:1788535924.072841:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589247232 00000100:00100000:1.0:1788535924.072924:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1788535924.072936:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+61:10541:x1875415589247232:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788535924.073053:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+61:10541:x1875415589247232:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 119us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535924.073074:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1788535924.077754:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535924.077957:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589247360 00000100:00100000:3.0:1788535924.077967:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589247360 00000100:00100000:3.0:1788535924.078032:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:3.0:1788535924.078042:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+10:10541:x1875415589247360:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535924.078059:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535924.078077:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4215 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751580b expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.078106:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d420e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515804 expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.078127:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535924.078131:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535924.078137:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4215 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751580b expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.078169:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d420e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515804 expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.078181:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d420e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515804 expref: 11 pid: 6673 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535924.078194:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a983668a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1875415607082624:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535924.078277:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b668ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788535924.081648:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535924.081929:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a983668a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1875415607082624:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535924.081967:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4215 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751580b expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.081985:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b800, rc 0) 00000100:00100000:1.0:1788535924.082042:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+11:10541:x1875415589247360:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 4002us (4298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535924.082050:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1788535924.082214:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589247488 00000100:00100000:2.0:1788535924.082221:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589247488 00010000:00010000:2.0:1788535924.082254:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d420e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515804 expref: 11 pid: 6673 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535924.082288:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:2.0:1788535924.082298:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a98366ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+11:2356:x1875415589247488:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535924.082310:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535924.082330:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d420e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515804 expref: 11 pid: 6673 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.082341:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d420e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515804 expref: 11 pid: 6673 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.082364:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d420e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515804 expref: 11 pid: 6673 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.082377:0:7598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535924.082381:0:7598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535924.082388:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4215 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751580b expref: 10 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.082397:0:7598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4215 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751580b expref: 10 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.082455:0:7598:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4215 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751580b expref: 10 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535924.082470:0:7598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7598:1875415607082752:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788535924.082521:0:7598:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b8d6b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788535924.086433:0:7598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7598:1875415607082752:192.168.203.12@tcp:105: 00010000:00010000:2.0:1788535924.086459:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535924.086565:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a98366ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+10:2356:x1875415589247488:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4267us (4925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535924.086576:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:3.0:1788535924.089581:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535924.089928:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589247616 00000100:00100000:1.0:1788535924.089939:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589247616 00002000:00100000:1.0:1788535924.089991:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97a98366bb80 x1875415589247616/t0(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:580/0 lens 504/0 e 0 to 0 dl 1788535935 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788535924.090002:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a98366bb80 with x1875415589247616 ext(0->12) 00002000:00010000:1.0:1788535924.090009:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a98366bb80 00000100:00100000:1.0:1788535924.090046:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:1.0:1788535924.090055:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a98366bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:30a1922d-0d3f-4681-a966-cec3672631c6+10:2356:x1875415589247616:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788535924.090933:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a98366bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:30a1922d-0d3f-4681-a966-cec3672631c6+12:2356:x1875415589247616:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 874us (1357us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788535924.090944:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00002000:00100000:1.0:1788535924.090953:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97a98366bb80 x1875415589247616/t4294967308(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:580/0 lens 504/448 e 0 to 0 dl 1788535935 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788535924.090975:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a98366bb80 with x1875415589247616 ext(0->12) 00002000:00010000:1.0:1788535924.090979:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a98366bb80 00000100:00100000:3.0:1788535924.094593:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535924.094916:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589247744 00000100:00100000:1.0:1788535924.094926:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589247744 00000100:00100000:1.0:1788535924.094990:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:1.0:1788535924.095001:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a98366b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+61:10541:x1875415589247744:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788535924.124930:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000004:00080000:0.0:1788535924.124944:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1788535924.125171:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a98366b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+58:10541:x1875415589247744:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 30166us (30583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535924.125182:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:3.0:1788535924.127480:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535924.127501:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a98366a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607082880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788535924.127578:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535924.127626:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607082880 00000100:00100000:3.0:1788535924.127632:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607082880 00000100:00100000:3.0:1788535924.127676:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788535924.127747:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3311:x1875415607082880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788535924.127771:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1788535924.127811:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ae473, atime: 0x6a9ae473, ctime: 0x6a9ae473, blocks: 0x1 00010000:00010000:3.0:1788535924.127818:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d421c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.127907:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1788535924.127911:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535924.127917:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d421c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.127934:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d421c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.127944:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d421c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.127952:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d421c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.127970:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788535924.128602:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3311:x1875415607082880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 917us (1023us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788535924.128610:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788535924.128635:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535924.128641:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d421c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.128650:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788535924.128661:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d421c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.128672:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d421c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.128697:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d421c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.128705:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d421c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.128722:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535924.128724:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535924.128726:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788535924.128798:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a992036b40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788535924.128803:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9b74e6400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a992036a80 00000020:00080000:0.0:1788535924.128806:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9b74e6000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a9bf276000 00000020:00080000:0.0:1788535924.128833:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a987f88480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788535924.128836:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9b74e6d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a987f88240 00000020:00080000:0.0:1788535924.128838:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9b74e6e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a98366ec00 00000001:00080000:0.0:1788535924.128850:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1788535924.128853:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:0.0:1788535924.128909:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788535924.128929:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788535924.128945:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1788535924.129136:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b735df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607083136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788535924.129182:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535924.129224:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607083136 00000100:00100000:0.0:1788535924.129231:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607083136 00000100:00100000:0.0:1788535924.129275:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788535924.129282:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875415607083136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788535924.129397:0:8424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788535924.129400:0:8424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788535924 00002000:00010000:0.0:1788535924.129403:0:8424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788535924.129405:0:8424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788535924 -> 1788535924 00002000:00010000:0.0:1788535924.129407:0:8424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788535924.129439:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875415607083136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (256us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788535924.129446:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788535924.129462:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788535924.129470:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535924.129478:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b735ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607083008:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788535924.129502:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788535924.129555:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a9b735df80/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788535924.129562:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b735df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607083136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788535924.129577:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607083008 00000100:00100000:0.0:1788535924.129581:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607083008 00000100:00100000:0.0:1788535924.129601:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788535924.129606:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875415607083008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788535924.129618:0:6671:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788535924.129633:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.129661:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006bc6b605/0x74f51638375d3fde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751576a expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.129668:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788535924.129672:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788535924.129677:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.129701:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006bc6b605/0x74f51638375d3fde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751576a expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.129715:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006bc6b605/0x74f51638375d3fde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751576a expref: 11 pid: 6671 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535924.129725:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b735c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1875415607083264:192.168.203.12@tcp:104: 00000020:00080000:3.0:1788535924.129931:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788535924.130079:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788535924.130338:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987964780 going to sleep for 11 seconds 00000004:00080000:2.0:1788535924.130415:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a98366a680/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788535924.130422:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a98366a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607082880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788535924.130537:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535924.131207:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589247872 00000100:00100000:0.0:1788535924.131215:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589247872 00000100:00100000:0.0:1788535924.131264:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:0.0:1788535924.131272:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+12:2355:x1875415589247872:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788535924.139820:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535924.140293:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b735c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1875415607083264:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535924.140321:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535924.140379:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589248000 00000100:00100000:3.0:1788535924.140387:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589248000 00010000:00010000:3.0:1788535924.140422:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006bc6b605/0x74f51638375d3fde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751576a expref: 13 pid: 6671 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535924.140462:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:3.0:1788535924.140471:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+13:2355:x1875415589248000:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535924.140486:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535924.140491:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006bc6b605/0x74f51638375d3fde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751576a expref: 13 pid: 6671 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.140522:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006bc6b605/0x74f51638375d3fde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751576a expref: 13 pid: 6671 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.140555:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bc6b605/0x74f51638375d3fde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751576a expref: 13 pid: 6671 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.140572:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535924.140576:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535924.140583:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.140592:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.140622:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535924.140672:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+12:2355:x1875415589248000:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 201us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535924.140681:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00010000:00010000:0.0:1788535924.141419:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.141444:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.141454:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.141462:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.141486:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788535924.142075:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3310:x1875415607083008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12464us (12568us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788535924.142083:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1788535924.142132:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a9b735ce00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788535924.142138:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b735ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607083008:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788535924.142656:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535924.142664:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.142674:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca800 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788535924.142678:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.142701:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.142720:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.142740:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4223 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.142759:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535924.142760:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535924.142762:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788535924.168495:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1788535924.168513:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788535924.168673:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589247872:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 37395us (38130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535924.171343:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535924.171444:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589248256 00000100:00100000:1.0:1788535924.171453:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589248256 00000100:00100000:1.0:1788535924.171512:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:1.0:1788535924.171522:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+15:10541:x1875415589248256:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788535924.171581:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535924.171609:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4207 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157fd expref: 15 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.171626:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a997503600) 00010000:00010000:1.0:1788535924.171631:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535924.171657:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d422a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.171668:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d422a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535924.171677:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d422a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788535924.171991:0:6697:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000002ecb899e reply state 0000000008fca723 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d422a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535924.172001:0:6697:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535924.172092:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+16:10541:x1875415589248256:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 572us (759us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788535924.172099:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00010000:00010000:3.0:1788535924.174286:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d422a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.174301:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d422a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.174309:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d422a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.174314:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ac00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535924.174319:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d422a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.174327:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d422a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.174360:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a997503600) 00010000:00010000:3.0:1788535924.174363:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535924.174368:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d422a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.174374:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d422a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535924.175204:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535924.175536:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1788535924.175584:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589248384 00000100:00100000:2.0:1788535924.175604:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589248384 00000100:00100000:2.0:1788535924.175646:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1788535924.175654:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589248384:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788535924.175986:0:8424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788535924.175990:0:8424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788535924 -> 1788535923 00002000:00010000:2.0:1788535924.175993:0:8424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788535923 00002000:00010000:2.0:1788535924.175995:0:8424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788535924 -> 1788535923 00002000:00010000:2.0:1788535924.175997:0:8424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788535924.176058:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+7:2356:x1875415589248384:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 405us (861us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788535924.176065:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1788535924.178360:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535924.178522:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589248640 00000100:00100000:2.0:1788535924.178531:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589248640 00000100:00100000:2.0:1788535924.178594:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:2.0:1788535924.178605:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+15:10541:x1875415589248640:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788535924.178668:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.178695:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d41eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157ef expref: 15 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.178706:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.178743:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d41eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157ef expref: 15 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.178757:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d41eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157ef expref: 15 pid: 11644 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535924.178788:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875415607083392:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788535924.178880:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b6c14b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535924.181305:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535924.181479:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875415607083392:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535924.181506:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535924.182589:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589248768 00000100:00100000:0.0:1788535924.182599:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589248768 00010000:00010000:0.0:1788535924.182640:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d41eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157ef expref: 16 pid: 11644 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535924.182680:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:0.0:1788535924.182697:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+16:2355:x1875415589248768:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535924.182712:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535924.182718:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d41eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157ef expref: 16 pid: 11644 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.182753:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d41eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157ef expref: 16 pid: 11644 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.182774:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d41eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157ef expref: 16 pid: 11644 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.182791:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a997503600) 00010000:00010000:0.0:1788535924.182795:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.182804:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.182811:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.182854:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535924.183090:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.183099:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.183128:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.183134:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.183141:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.183147:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535924.183151:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.183159:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.183180:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a997503600) 00010000:00010000:3.0:1788535924.183182:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788535924.183185:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.183191:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4231 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535924.183630:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+15:2355:x1875415589248768:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 931us (2331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535924.183638:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:3.0:1788535924.183815:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+14:10541:x1875415589248640:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 5210us (5462us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788535924.183833:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:1.0:1788535924.190297:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535924.190389:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589248896 00000100:00100000:0.0:1788535924.190400:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589248896 00000100:00100000:0.0:1788535924.190505:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1788535924.190517:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+7:2357:x1875415589248896:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788535924.190570:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.190606:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4215 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751580b expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.190615:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535924.190619:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788535924.190624:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.190660:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4215 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751580b expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.190674:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4215 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751580b expref: 7 pid: 6671 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535924.190701:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b735f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1875415607083520:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535924.190778:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ac54d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535924.193091:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b735f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1875415607083520:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535924.193120:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535924.194629:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535924.194930:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589249024 00000100:00100000:2.0:1788535924.194940:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589249024 00010000:00010000:2.0:1788535924.194976:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4215 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751580b expref: 8 pid: 6671 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535924.195018:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:2.0:1788535924.195027:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589249024:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535924.195040:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535924.195059:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4215 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751580b expref: 8 pid: 6671 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.195072:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4215 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751580b expref: 8 pid: 6671 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.195092:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4215 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751580b expref: 8 pid: 6671 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.195107:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788535924.195123:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788535924.195130:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.195140:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.195166:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535924.195211:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2355:x1875415589249024:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 185us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535924.195218:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00010000:00010000:0.0:1788535924.195867:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.195881:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.195939:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.195948:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.195957:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.195964:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecac00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788535924.195969:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.195977:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.195992:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535924.195999:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4238 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535924.196080:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2357:x1875415589248896:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 5565us (5791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535924.196088:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:1.0:1788535924.199752:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535924.200031:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589249280 00000100:00100000:2.0:1788535924.200041:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589249280 00000100:00100000:2.0:1788535924.200095:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:2.0:1788535924.200105:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+14:10541:x1875415589249280:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788535924.200180:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d423f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.200197:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d423f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.200208:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d423f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.200408:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.200420:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d41f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157f6 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.200446:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.200478:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d41f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157f6 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.200492:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d41f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157f6 expref: 15 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535924.200506:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61af800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875415607083648:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788535924.200599:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b6c14b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788535924.203638:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61af800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875415607083648:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535924.203669:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535924.204813:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535924.205002:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589249408 00000100:00100000:2.0:1788535924.205012:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589249408 00010000:00010000:2.0:1788535924.205054:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d41f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157f6 expref: 16 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535924.205092:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1788535924.205102:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+16:2355:x1875415589249408:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535924.205117:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535924.205123:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d41f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157f6 expref: 16 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.205156:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d41f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157f6 expref: 16 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.205177:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d41f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157f6 expref: 16 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.205193:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a997503600) 00010000:00010000:2.0:1788535924.205199:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.205207:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.205215:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.205249:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535924.205305:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+15:2355:x1875415589249408:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 204us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535924.205312:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00010000:00010000:3.0:1788535924.205487:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.205496:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535924.205694:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1788535924.205845:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788535924.205950:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1788535924.206029:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a983668700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875415607083776:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788535924.206080:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535924.206109:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b668ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535924.206692:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607083776 00000100:00100000:2.0:1788535924.206700:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607083776 00000100:00100000:2.0:1788535924.206754:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788535924.206763:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875415607083776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788535924.206853:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875415607083776:12345-0@lo:1000:mdt00_001.0 Request processed in 91us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535924.206860:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788535924.207254:0:5833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788535924.207261:0:5833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1788535924.207281:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a9b735df80, transno 4294967309 00000100:00100000:3.0:1788535924.207292:0:5833:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff97a9b735ce00 x1875415607083008/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788535940 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535924.207303:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a983668700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875415607083776:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788535924.207807:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788535924.208393:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a983668700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875415607083904:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788535924.208445:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535924.208472:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b8d6b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788535924.208578:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607083904 00000100:00100000:2.0:1788535924.208585:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607083904 00000100:00100000:2.0:1788535924.208629:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788535924.208637:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a98366a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875415607083904:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788535924.209058:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a98366a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5833:x1875415607083904:12345-0@lo:1000:mdt00_001.0 Request processed in 421us (610us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788535924.209067:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788535924.209217:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a983668700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875415607083904:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788535924.209250:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209260:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209267:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209274:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535924.209278:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209286:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209302:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a997503600) 00010000:00010000:3.0:1788535924.209304:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788535924.209309:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209316:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4246 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209346:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4189 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209362:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4189 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209368:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4189 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209372:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4bc00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535924.209376:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4189 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209381:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4189 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209390:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535924.209392:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788535924.209399:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e200/0x74f51638375d4190 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157da expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209411:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e200/0x74f51638375d4190 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157da expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209419:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e200/0x74f51638375d4190 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157da expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.209447:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e200/0x74f51638375d4190 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157da expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535924.209459:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a983668a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875415607084032:192.168.203.12@tcp:105: 00000100:00100000:3.0:1788535924.209542:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b8d6b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788535924.215369:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a983668a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875415607084032:192.168.203.12@tcp:105: 00010000:00010000:3.0:1788535924.215402:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4189 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215413:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4189 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215443:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d424d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215456:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d424d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215468:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d424d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215479:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d424d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215485:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d424d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215490:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d424d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215496:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535924.215500:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d424d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215506:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d424d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215535:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535924.215538:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535924.215542:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d424d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215558:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d424d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215568:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d423f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215574:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d423f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215579:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d423f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215584:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ea00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535924.215587:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d423f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215593:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d423f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215600:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535924.215602:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788535924.215605:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d423f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.215610:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d423f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535924.215921:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+18:10541:x1875415589249280:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 15815us (16175us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788535924.215931:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000020:00080000:3.0:1788535924.215937:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788535924.216087:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535924.216091:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535924.216121:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788535924.216127:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788535924.218347:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535924.218633:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589249536 00000100:00100000:3.0:1788535924.218642:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589249536 00000100:00100000:3.0:1788535924.218701:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1788535924.218711:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+18:10540:x1875415589249536:12345-192.168.203.12@tcp:49:lfs.0 00000100:00100000:3.0:1788535924.218817:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+18:10540:x1875415589249536:12345-192.168.203.12@tcp:49:lfs.0 Request processed in 107us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535924.218962:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1788535924.223518:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535924.223600:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535924.223701:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589249792 00000100:00100000:3.0:1788535924.223711:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589249792 00000100:00100000:3.0:1788535924.223773:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1788535924.223783:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99c78a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+18:10541:x1875415589249792:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788535924.224670:0:5835:0:(mdd_object.c:4338:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788535924.225109:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788535924.225155:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4254 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.225172:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.225184:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.225192:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4254 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.225206:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4254 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.225212:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4254 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.225281:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788535924.225383:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99c78a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+20:10541:x1875415589249792:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 1598us (1871us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788535924.225392:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000020:00080000:3.0:1788535924.225398:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788535924.227153:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589250048 00000100:00100000:0.0:1788535924.227166:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589250048 00000100:00100000:0.0:1788535924.227222:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:0.0:1788535924.227232:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+20:10540:x1875415589250048:12345-192.168.203.12@tcp:58:lfs.0 00000040:00080000:0.0:1788535924.227467:0:11644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788535924.227565:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+20:10540:x1875415589250048:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 333us (3963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535924.227573:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00010000:00010000:2.0:1788535924.228730:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535924.228744:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4254 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.228756:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:2.0:1788535924.228760:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4254 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.228770:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4254 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.228786:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97a997503600) 00010000:00010000:2.0:1788535924.228789:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788535924.228794:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4254 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.228800:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4254 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.228823:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535924.228826:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535924.228828:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535924.253944:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535924.254033:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589250176 00000100:00100000:3.0:1788535924.254042:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589250176 00000100:00100000:3.0:1788535924.254101:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:3.0:1788535924.254117:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+20:10543:x1875415589250176:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535924.254139:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535924.254157:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d425b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515812 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.254215:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4262 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.254230:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.254242:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.254257:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4269 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.254279:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.254286:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.254516:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.254527:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157d3 expref: 21 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.254535:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4270 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.254577:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157d3 expref: 21 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.254590:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157d3 expref: 21 pid: 6697 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535924.254603:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a983668a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875415607084160:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535924.254677:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b8d6b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788535924.256510:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a983668a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875415607084160:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788535924.256538:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535924.257794:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535924.257998:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589250432 00000100:00100000:0.0:1788535924.258007:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589250432 00000100:00100000:0.0:1788535924.258082:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788535924.258094:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+22:5593:x1875415589250432:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788535924.258511:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+23:5593:x1875415589250432:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 417us (720us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788535924.258520:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788535924.267703:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535924.270572:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589250560 00000100:00100000:2.0:1788535924.270588:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589250560 00010000:00010000:2.0:1788535924.270664:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157d3 expref: 23 pid: 6697 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535924.270713:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1788535924.270723:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+23:2356:x1875415589250560:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535924.270738:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535924.270744:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157d3 expref: 23 pid: 6697 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.270757:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157d3 expref: 23 pid: 6697 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.270778:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d417b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157d3 expref: 23 pid: 6697 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.270796:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:2.0:1788535924.270802:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.270812:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.270821:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4270 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535924.270856:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535924.270917:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.270935:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535924.270981:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:2.0:1788535924.270982:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+22:2356:x1875415589250560:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 259us (3288us total) trans 0 rc 0/0 00000004:00200000:3.0:1788535924.270988:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1788535924.270993:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000004:00010000:3.0:1788535924.271023:0:5832:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.271038:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.271046:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.271053:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4262 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.271059:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4262 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.271064:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4bc00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535924.271068:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4262 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.271075:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4262 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.271084:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:3.0:1788535924.271087:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535924.271091:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4262 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.272020:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4262 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.272043:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.272050:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4269 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.272058:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.272063:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535924.272987:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.273002:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.273017:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97a997503900) 00010000:00010000:3.0:1788535924.273021:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535924.273025:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4269 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.273032:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4269 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.273080:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d425b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515812 expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.273341:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515812 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535924.275408:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535924.275412:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535924.275415:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4a400, rc 0) 00000100:00100000:2.0:1788535924.275646:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+21:10543:x1875415589250176:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 21526us (21706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535924.275656:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00000001:00080000:2.0:1788535924.572816:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788535924.572829:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1788535924.573340:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788535924.573348:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:3.0:1788535924.621478:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788535925.149469:0:12012:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535925.149478:0:12012:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788535925.149550:0:12012:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788535925.149557:0:12012:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788535925.261068:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535925.261078:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535925.261125:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788535925.261132:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788535925.261256:0:11640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b735f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11640:1875415607084288:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788535925.261355:0:11640:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b668ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535925.269387:0:11640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b735f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11640:1875415607084288:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788535925.280198:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535925.280240:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589250688 00000100:00100000:3.0:1788535925.280250:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589250688 00000100:00100000:3.0:1788535925.280310:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:3.0:1788535925.280321:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+21:10555:x1875415589250688:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788535925.280357:0:5833:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788535925.280462:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+21:10555:x1875415589250688:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 141us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535925.280470:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00080000:3.0:1788535925.280493:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535925.298243:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535925.298613:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589250944 00000100:00100000:3.0:1788535925.298622:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589250944 00000100:00100000:3.0:1788535925.298681:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:3.0:1788535925.298691:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+21:10555:x1875415589250944:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535925.298713:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535925.298731:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4277 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515819 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535925.298838:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d427e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535925.298853:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d427e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535925.298865:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d427e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535925.298875:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788535925.299027:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4277 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515819 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535925.299044:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d427e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515819 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535925.299058:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535925.299061:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535925.299065:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4a200, rc 0) 00000100:00100000:3.0:1788535925.299123:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+23:10555:x1875415589250944:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 433us (889us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788535925.299131:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:0.0:1788535925.312878:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535925.313173:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589251072 00000100:00100000:3.0:1788535925.313183:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589251072 00000100:00100000:0.0:1788535925.313250:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535925.315124:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589251328 00000100:00100000:1.0:1788535925.315138:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589251328 00000100:00100000:1.0:1788535925.315197:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:1.0:1788535925.315208:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+24:10555:x1875415589251328:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788535925.315288:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d428c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535925.315305:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d428c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535925.315316:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d428c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535925.315606:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d428c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535925.315616:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d428c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535925.315624:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d428c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535925.315630:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535925.315635:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d428c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535925.315642:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d428c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535925.315656:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:1.0:1788535925.315659:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788535925.315663:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d428c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535925.315670:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d428c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535925.315863:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788535925.315875:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+25:2357:x1875415589251072:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535925.315913:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788535925.315915:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+25:10555:x1875415589251328:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 705us (2662us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788535925.315927:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 132 00010000:00010000:3.0:1788535925.315938:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d427e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515819 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535925.315953:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535925.315957:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535925.315980:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+23:2357:x1875415589251072:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 109us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535925.315987:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000040:00080000:1.0:1788535925.316040:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788535925.316045:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788535925.316627:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788535925.316645:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788535925.321583:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535925.321660:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589251584 00000100:00100000:0.0:1788535925.321670:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589251584 00000100:00100000:0.0:1788535925.321727:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1788535925.321736:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+23:10555:x1875415589251584:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788535925.322348:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+24:10555:x1875415589251584:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 609us (771us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788535925.322357:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00010000:00010000:3.0:1788535925.647501:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535926.541333:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607084672:0@lo:400:kworker.0 00000100:00100000:2.0:1788535926.541422:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535926.541499:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788535926.541505:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607084544:0@lo:400:kworker.0 00000100:00100000:2.0:1788535926.541544:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535926.541563:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607085056:0@lo:400:kworker.0 00000100:00100000:1.0:1788535926.541598:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607084672 00000100:00100000:1.0:1788535926.541606:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607084672 00000100:00100000:1.0:1788535926.541655:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607084544 00000100:00100000:1.0:1788535926.541659:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607084544 00000100:00100000:1.0:1788535926.541680:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788535926.541689:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607084672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535926.541738:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607084672:12345-0@lo:400:kworker.0 Request processed in 49us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535926.541745:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788535926.541762:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788535926.541768:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607084544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535926.541793:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607084544:12345-0@lo:400:kworker.0 Request processed in 26us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535926.541799:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1788535926.541824:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535926.541841:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607084416:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.541918:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535926.541948:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607084928:0@lo:400:kworker.0 00000100:00100000:1.0:1788535926.541953:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607084416 00000100:00100000:1.0:1788535926.541957:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607084416 00000100:00100000:0.0:1788535926.541979:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535926.541984:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788535926.541990:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3309:x1875415607084416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.542105:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788535926.542112:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607084800:0@lo:400:kworker.0 00000100:00100000:2.0:1788535926.542170:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535926.543800:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607084928 00000100:00100000:3.0:1788535926.543811:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607084928 00000100:00100000:3.0:1788535926.543869:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788535926.543877:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875415607084928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535926.546086:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3309:x1875415607084416:12345-0@lo:400:kworker.0 Request processed in 4086us (4189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535926.546837:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535926.547032:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788535926.553456:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607084672:0@lo:400:kworker.0 00000100:00100000:2.0:1788535926.553488:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607084544:0@lo:400:kworker.0 00000100:00100000:2.0:1788535926.553521:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607085056 00000100:00100000:2.0:1788535926.553538:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607085056 00000100:00100000:2.0:1788535926.553606:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607084800 00000100:00100000:2.0:1788535926.553609:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607084800 00000100:00100000:2.0:1788535926.553805:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788535926.553819:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875415607085056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.553971:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788535926.553981:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607084800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.554024:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607084800:12345-0@lo:400:kworker.0 Request processed in 45us (7189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535926.554031:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788535926.554134:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788535926.554139:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:0.0:1788535926.554155:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a9b61ac700, transno 4294967301 00000004:00080000:0.0:1788535926.554167:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788535926.554191:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a98366a680, transno 4294967304 00000100:00100000:0.0:1788535926.554197:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607084800:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.554439:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607084416:0@lo:400:kworker.0 00000100:00080000:0.0:1788535926.554474:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788535926.554479:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535926.554482:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535926.554802:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875415607085056:12345-0@lo:400:kworker.0 Request processed in 984us (13204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535926.554819:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788535926.555008:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875415607084928:12345-0@lo:400:kworker.0 Request processed in 11130us (13027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535926.555018:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788535926.555265:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607084928:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.555343:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607085056:0@lo:400:kworker.0 00000100:00100000:3.0:1788535926.649830:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535926.649862:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535926.649927:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535926.649952:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535926.649973:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535926.649999:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589252096 00000100:00100000:3.0:1788535926.650008:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589252096 00000100:00100000:3.0:1788535926.650054:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589251968 00000100:00100000:3.0:1788535926.650057:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589251968 00000100:00100000:3.0:1788535926.650080:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1788535926.650088:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589252096:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535926.650158:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589252096:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 70us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535926.650174:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1788535926.650191:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1788535926.650197:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+5:2356:x1875415589251968:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535926.650223:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+5:2356:x1875415589251968:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535926.650229:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1788535926.650251:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589251840 00000100:00100000:3.0:1788535926.650255:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589251840 00000100:00100000:3.0:1788535926.650276:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589252224 00000100:00100000:3.0:1788535926.650279:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589252224 00000100:00100000:3.0:1788535926.650300:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:3.0:1788535926.650306:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a98366ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+24:2355:x1875415589251840:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535926.650337:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a98366ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+24:2355:x1875415589251840:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535926.650343:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:3.0:1788535926.650355:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:3.0:1788535926.650361:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a98366a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589252224:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535926.650383:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a98366a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589252224:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535926.650389:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00080000:3.0:1788535926.650483:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788535926.650488:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535926.650489:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788535926.651521:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589251712 00000100:00100000:2.0:1788535926.651542:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589251712 00000100:00100000:2.0:1788535926.651581:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 280 00000100:00100000:2.0:1788535926.651590:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2356:x1875415589251712:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535926.651648:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2356:x1875415589251712:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 60us (1828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535926.651656:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 280 00010000:00010000:0.0:1788535926.668988:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535927.053319:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607085184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535927.053396:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535927.053467:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607085184 00000100:00100000:3.0:1788535927.053474:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607085184 00000100:00100000:3.0:1788535927.053519:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788535927.053542:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875415607085184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788535927.053576:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788535927.053621:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875415607085184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535927.053628:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788535927.053866:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607085184:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788535927.068466:0:12063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788535927.068475:0:12063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788535927.068521:0:12063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788535927.075145:0:12063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788535927.292172:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535927.292260:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589252480 00000100:00100000:0.0:1788535927.292270:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589252480 00000100:00100000:0.0:1788535927.292342:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:0.0:1788535927.292354:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+24:10576:x1875415589252480:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535927.292374:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535927.292394:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4293 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515820 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.292493:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d429a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.292509:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d429a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.292535:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d429a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535927.292547:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788535927.292670:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4293 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515820 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.292706:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d429a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515820 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.292715:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:0.0:1788535927.292718:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788535927.292721:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecae00, rc 0) 00000100:00080000:3.0:1788535927.292905:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535927.294333:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+26:10576:x1875415589252480:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1971us (2158us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788535927.294346:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:3.0:1788535927.297674:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535927.297911:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589252608 00000100:00100000:0.0:1788535927.297921:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589252608 00000100:00100000:0.0:1788535927.297977:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:0.0:1788535927.297987:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+26:10576:x1875415589252608:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788535927.298055:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d42a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.298073:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d42a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.298085:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d42a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.298110:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d42a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.298117:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d42a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.298138:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d42a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.298144:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535927.298150:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d42a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.298157:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d42a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.298168:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:0.0:1788535927.298171:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788535927.298176:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d42a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.298183:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb200/0x74f51638375d42a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535927.298250:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+26:10576:x1875415589252608:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 263us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535927.298259:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:3.0:1788535927.384745:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535927.389215:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589252736 00000100:00100000:1.0:1788535927.389230:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589252736 00000100:00100000:0.0:1788535927.390902:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1788535927.390917:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2358:x1875415589252736:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1788535927.390993:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535927.391011:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eedb2c92/0x74f51638375d42af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515827 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535927.391035:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ae473, atime: 0x6a9ae473, ctime: 0x6a9ae473, blocks: 0xb 00010000:00010000:0.0:1788535927.391067:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1788535927.391072:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535927.391083:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eedb2c92/0x74f51638375d42af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515827 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.391103:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eedb2c92/0x74f51638375d42af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515827 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535927.391116:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecb200, rc 0) 00000100:00100000:0.0:1788535927.391338:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+7:2358:x1875415589252736:12345-192.168.203.12@tcp:101:cat.0 Request processed in 422us (6601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535927.391347:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788535927.403132:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535927.403540:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589252864 00000100:00100000:2.0:1788535927.403551:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589252864 00002000:00100000:2.0:1788535927.403600:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff97a9b6ac0a80 x1875415589252864/t0(0) o3->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:583/0 lens 488/0 e 0 to 0 dl 1788535938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788535927.403611:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b6ac0a80 with x1875415589252864 ext(0->4095) 00002000:00010000:2.0:1788535927.403616:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a9b6ac0a80 00000100:00100000:2.0:1788535927.403648:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788535927.403659:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2355:x1875415589252864:12345-192.168.203.12@tcp:3:cat.0 00000100:00100000:2.0:1788535927.403862:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2355:x1875415589252864:12345-192.168.203.12@tcp:3:cat.0 Request processed in 204us (739us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788535927.403870:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00002000:00100000:2.0:1788535927.404677:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff97a9b6ac0a80 x1875415589252864/t0(0) o3->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:583/0 lens 488/4536 e 0 to 0 dl 1788535938 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788535927.404687:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b6ac0a80 with x1875415589252864 ext(0->4095) 00002000:00010000:2.0:1788535927.404691:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a9b6ac0a80 00010000:00010000:3.0:1788535927.693334:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535928.086491:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b735ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607085312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535928.086574:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535928.086666:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607085312 00000100:00100000:2.0:1788535928.086674:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607085312 00000100:00100000:2.0:1788535928.086738:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788535928.086748:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607085312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788535928.086781:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788535928.086823:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607085312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535928.086835:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788535928.086884:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b735ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607085312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788535928.087050:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788535928.718623:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788535929.184563:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788535929.184612:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a9b8d6b300 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788535929.184617:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a987f6e200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a9b8d6b480 00000020:00080000:0.0:1788535929.184620:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a987f6e800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a9bf0e5c00 00000020:00080000:0.0:1788535929.184644:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788535929.184737:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788535929.184994:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1788535929.691707:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788535929.691725:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1788535929.691731:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:1.0:1788535929.745335:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535930.765113:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535931.664106:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607085824:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.664173:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.664230:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788535931.664237:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607085440:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.664265:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.664287:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607085952:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.664323:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.664347:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607085568:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.664368:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.664386:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607086080:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.664405:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.664422:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535931.664428:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607085696:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.664446:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.664477:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607085824 00000100:00100000:3.0:1788535931.664483:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607085824 00000100:00100000:3.0:1788535931.664542:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607086080 00000100:00100000:3.0:1788535931.664545:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607086080 00000100:00100000:0.0:1788535931.664662:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607085952 00000100:00100000:0.0:1788535931.664666:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607085952 00000100:00100000:0.0:1788535931.664691:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607085568 00000100:00100000:0.0:1788535931.664693:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607085568 00000100:00100000:0.0:1788535931.664707:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607085696 00000100:00100000:0.0:1788535931.664709:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607085696 00000100:00100000:0.0:1788535931.664722:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788535931.664729:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607085952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535931.664778:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607085952:12345-0@lo:400:kworker.0 Request processed in 49us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535931.664791:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788535931.664808:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788535931.664814:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607085568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535931.664846:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607085568:12345-0@lo:400:kworker.0 Request processed in 32us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535931.664852:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788535931.664863:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788535931.664869:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607085696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535931.664912:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607085696:12345-0@lo:400:kworker.0 Request processed in 44us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535931.664917:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1788535931.664931:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788535931.664935:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535931.664937:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535931.665151:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788535931.665160:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607085824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.665191:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607085824:12345-0@lo:400:kworker.0 Request processed in 34us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.665197:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788535931.665209:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788535931.665215:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607086080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.665240:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607086080:12345-0@lo:400:kworker.0 Request processed in 26us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.665246:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788535931.672332:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607085440 00000100:00100000:2.0:1788535931.672345:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607085440 00000100:00100000:2.0:1788535931.672402:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788535931.672412:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607085440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535931.672490:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607085440:12345-0@lo:400:kworker.0 Request processed in 80us (8223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535931.672507:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788535931.675437:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607085696:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.675456:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607085568:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.675466:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788535931.675477:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a9b735ce00, transno 4294967310 00000004:00080000:3.0:1788535931.675509:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788535931.675530:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607086080:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.675581:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607085440:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.675595:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607085952:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.675606:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607085824:0@lo:400:kworker.0 00000100:00100000:0.0:1788535931.768355:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535931.768397:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535931.768435:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535931.768458:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535931.768478:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535931.768516:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589253504 00000100:00100000:0.0:1788535931.768526:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589253504 00000100:00100000:0.0:1788535931.768587:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589253120 00000100:00100000:0.0:1788535931.768591:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589253120 00000100:00100000:0.0:1788535931.768615:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:0.0:1788535931.768625:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589253504:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535931.768693:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589253504:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535931.768711:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:0.0:1788535931.768729:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:0.0:1788535931.768735:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+13:2356:x1875415589253120:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535931.768760:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+13:2356:x1875415589253120:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535931.768766:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00080000:0.0:1788535931.768784:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535931.768832:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589253248 00000100:00100000:1.0:1788535931.768837:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589253248 00000100:00100000:1.0:1788535931.768876:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589253376 00000100:00100000:1.0:1788535931.768879:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589253376 00000100:00100000:1.0:1788535931.768922:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:1.0:1788535931.768939:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+5:2356:x1875415589253248:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535931.768966:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+5:2356:x1875415589253248:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535931.768972:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:1.0:1788535931.768983:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1788535931.768990:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589253376:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535931.769010:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589253376:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535931.769016:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:3.0:1788535931.769186:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589252992 00000100:00100000:3.0:1788535931.769191:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589252992 00000100:00100000:3.0:1788535931.769226:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 282 00000100:00100000:3.0:1788535931.769233:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2356:x1875415589252992:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535931.769258:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2356:x1875415589252992:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.769264:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 282 00000100:00080000:0.0:1788535931.769500:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535931.769504:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788535931.789831:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535932.052044:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535932.052140:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589253632 00000100:00100000:2.0:1788535932.052151:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589253632 00000100:00100000:2.0:1788535932.052214:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:2.0:1788535932.052225:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+13:10227:x1875415589253632:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788535932.052368:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+13:10227:x1875415589253632:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 144us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535932.052377:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:3.0:1788535932.056067:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535932.056177:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589253888 00000100:00100000:0.0:1788535932.056189:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589253888 00000100:00100000:0.0:1788535932.056256:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1788535932.056268:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+13:10227:x1875415589253888:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788535932.056619:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+14:10227:x1875415589253888:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 351us (562us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788535932.056627:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1788535932.173440:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535932.173468:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607086208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535932.173568:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535932.173728:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607086208 00000100:00100000:1.0:1788535932.173737:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607086208 00000100:00100000:1.0:1788535932.173789:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788535932.173799:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607086208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535932.173842:0:10342:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535932.173930:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607086208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535932.173938:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788535932.174805:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607086208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535932.314931:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535932.315026:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589254016 00000100:00100000:0.0:1788535932.315039:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589254016 00000100:00100000:0.0:1788535932.315109:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:0.0:1788535932.315120:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ebecc8-0d84-4b23-8d21-de56113948a9+5:11029:x1875415589254016:12345-192.168.203.12@tcp:101:lsof.0 00010000:00010000:0.0:1788535932.315155:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535932.315177:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d42b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751582e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535932.315241:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d42bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535932.315256:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d42bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535932.315270:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d42bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535932.315306:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788535932.315311:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535932.315351:0:5833:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d42bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535932.315376:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d42b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751582e expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535932.315394:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d42bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751582e expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535932.315404:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9a0685800) 00010000:00010000:0.0:1788535932.315407:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788535932.315411:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987eca800, rc 0) 00000100:00100000:0.0:1788535932.315478:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ebecc8-0d84-4b23-8d21-de56113948a9+6:11029:x1875415589254016:12345-192.168.203.12@tcp:101:lsof.0 Request processed in 359us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535932.315486:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 136 00010000:00010000:1.0:1788535932.813531:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535933.197213:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535933.197236:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b735e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607086336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535933.197301:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535933.197622:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607086336 00000100:00100000:0.0:1788535933.197631:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607086336 00000100:00100000:0.0:1788535933.197700:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788535933.197710:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607086336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788535933.197742:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535933.197798:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607086336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535933.197805:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788535933.197948:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b735e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607086336:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788535933.198071:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788535933.837113:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788535934.285230:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788535934.285251:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788535934.288098:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788535934.288121:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:1.0:1788535934.541215:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788535934.541223:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788535934.541486:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788535934.541499:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788535934.861505:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535935.889142:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788535936.339800:0:12262:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 11:32:15 (1788535935) 00000100:00100000:2.0:1788535936.781629:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607086848:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.781690:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535936.781744:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788535936.781750:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607086464:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.781775:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535936.781794:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607086976:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.781816:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535936.781842:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607086592:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.781862:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535936.781876:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607087104:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.781914:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535936.781928:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788535936.781933:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607086720:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.781950:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535936.781976:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607086848 00000100:00100000:2.0:1788535936.781983:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607086848 00000100:00100000:2.0:1788535936.782037:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607087104 00000100:00100000:2.0:1788535936.782040:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607087104 00000100:00100000:2.0:1788535936.782055:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788535936.782062:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607086848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.782105:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607086848:12345-0@lo:400:kworker.0 Request processed in 43us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.782112:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788535936.782127:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788535936.782146:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607087104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.782172:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607087104:12345-0@lo:400:kworker.0 Request processed in 27us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.782177:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788535936.782191:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607086464 00000100:00100000:2.0:1788535936.782194:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607086464 00000100:00100000:2.0:1788535936.782210:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788535936.782215:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607086464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.782239:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607086464:12345-0@lo:400:kworker.0 Request processed in 23us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.782244:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788535936.782267:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607086976 00000100:00100000:2.0:1788535936.782270:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607086976 00000100:00100000:2.0:1788535936.782289:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607086592 00000100:00100000:2.0:1788535936.782291:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607086592 00000100:00100000:2.0:1788535936.782301:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607086720 00000100:00100000:2.0:1788535936.782303:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607086720 00000100:00100000:2.0:1788535936.782314:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788535936.782319:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607086976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.782343:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875415607086976:12345-0@lo:400:kworker.0 Request processed in 24us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.782354:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788535936.782364:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788535936.782369:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607086592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.782389:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607086592:12345-0@lo:400:kworker.0 Request processed in 21us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.782394:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788535936.782402:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788535936.782407:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607086720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.782425:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607086720:12345-0@lo:400:kworker.0 Request processed in 18us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.782430:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1788535936.782449:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535936.782454:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535936.782467:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535936.782498:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607086720:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.782507:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607086592:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.782514:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607087104:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.782538:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607086464:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.782546:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607086976:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.782553:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607086848:0@lo:400:kworker.0 00000100:00100000:1.0:1788535936.897164:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535936.897214:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535936.897255:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535936.897287:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535936.897370:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535936.897374:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589254144 00000100:00100000:2.0:1788535936.897385:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589254144 00000100:00100000:1.0:1788535936.897391:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589254656 00000100:00100000:1.0:1788535936.897394:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589254656 00000100:00100000:1.0:1788535936.897426:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589254272 00000100:00100000:1.0:1788535936.897428:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589254272 00000100:00100000:2.0:1788535936.897431:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 284 00000100:00100000:1.0:1788535936.897446:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:2.0:1788535936.897452:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2355:x1875415589254144:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535936.897452:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+6:2355:x1875415589254656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535936.897530:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2355:x1875415589254144:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 78us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.897538:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 284 00000100:00100000:3.0:1788535936.897548:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589254400 00000100:00100000:3.0:1788535936.897552:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589254400 00000100:00100000:2.0:1788535936.897575:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:3.0:1788535936.897579:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589254528 00000100:00100000:3.0:1788535936.897582:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589254528 00000100:00100000:2.0:1788535936.897582:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+13:2355:x1875415589254272:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535936.897601:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:3.0:1788535936.897606:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+5:2355:x1875415589254400:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:0.0:1788535936.897695:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535936.897699:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788535936.897701:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535936.905201:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+6:2355:x1875415589254656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 7735us (7931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535936.905216:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:1.0:1788535936.905338:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1788535936.905354:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589254528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535936.905407:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589254528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 60us (8036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535936.905414:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1788535936.906908:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+5:2355:x1875415589254400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 9267us (9659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535936.906922:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:2.0:1788535936.910212:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+13:2355:x1875415589254272:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 12469us (12762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.910231:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00010000:00010000:3.0:1788535936.915031:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535937.293552:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535937.293578:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607087232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535937.293659:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535937.293855:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607087232 00000100:00100000:2.0:1788535937.293863:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607087232 00000100:00100000:2.0:1788535937.293945:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788535937.293956:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607087232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535937.293994:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788535937.294056:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607087232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535937.294080:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788535937.294173:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607087232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535937.887275:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535937.887434:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589254912 00000100:00100000:2.0:1788535937.887445:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589254912 00000100:00100000:2.0:1788535937.887516:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:2.0:1788535937.887526:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+13:11294:x1875415589254912:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535937.887546:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535937.887566:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d42c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515835 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.887655:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d42cb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.887669:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d42cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.887683:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d42cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.887697:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d42d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.887703:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d42d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.887709:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d42d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888113:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d42d9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888125:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d42d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888133:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d42d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535937.888142:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788535937.888430:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d42cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888482:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d42cb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888490:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d42cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888499:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535937.888503:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d42cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888512:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d42cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888523:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a9888ade00) 00010000:00010000:2.0:1788535937.888526:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535937.888530:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d42cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888536:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d42cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888549:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d42d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888558:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d42d2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888565:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d42d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888570:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535937.888579:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d42d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888586:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d42d2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888598:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97a99742a000) 00010000:00010000:2.0:1788535937.888601:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535937.888604:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d42d2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.888609:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d42d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.889100:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d42c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515835 expref: 16 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.889117:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d42d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515835 expref: 15 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.889125:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a99742a400) 00010000:00010000:2.0:1788535937.889128:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535937.889130:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747fe00, rc 0) 00000100:00100000:2.0:1788535937.889199:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+15:11294:x1875415589254912:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1673us (1932us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788535937.889207:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:0.0:1788535937.900834:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535937.900919:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535937.900998:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589255168 00000100:00100000:1.0:1788535937.901008:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589255168 00000100:00100000:1.0:1788535937.901090:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1788535937.901101:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+15:2358:x1875415589255168:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535937.901116:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535937.901141:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d42d9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515835 expref: 15 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.901158:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a99742a400) 00010000:00010000:1.0:1788535937.901163:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535937.901230:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+14:2358:x1875415589255168:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 130us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535937.901237:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788535937.901872:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589255040 00000100:00100000:2.0:1788535937.901881:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589255040 00000100:00100000:2.0:1788535937.901999:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:2.0:1788535937.902008:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+14:11294:x1875415589255040:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788535937.902093:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+14:11294:x1875415589255040:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 86us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535937.902101:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 138 00010000:00010000:3.0:1788535937.933522:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535938.318469:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788535938.318493:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b735e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607087360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535938.318576:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535938.320020:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607087360 00000100:00100000:2.0:1788535938.320034:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607087360 00000100:00100000:2.0:1788535938.320099:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788535938.320111:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607087360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788535938.320283:0:10342:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788535938.320475:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535938.320687:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607087360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 578us (2109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535938.320695:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788535938.320794:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b735e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607087360:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788535938.641776:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788535938.641786:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788535938.641821:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788535938.641828:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788535938.957203:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788535939.394090:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:3.0:1788535939.981817:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535940.035880:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535940.036080:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589255296 00000100:00100000:3.0:1788535940.036091:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589255296 00000100:00100000:3.0:1788535940.036153:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:3.0:1788535940.036165:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+13:11336:x1875415589255296:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535940.036184:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535940.036204:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d42e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751583c expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036260:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d42ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036274:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d42ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036285:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d42ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036298:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d42f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036305:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d42f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036312:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d42f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036543:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d42ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036552:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d42ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036558:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d42ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036564:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4bc00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535940.036568:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d42ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036576:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d42ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036590:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9a0685800) 00010000:00010000:3.0:1788535940.036594:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535940.036598:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d42ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036604:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d42ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036614:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d42f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036619:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d42f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036625:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d42f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036636:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535940.036640:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d42f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036645:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d42f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036652:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97a997503300) 00010000:00010000:3.0:1788535940.036655:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535940.036657:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d42f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036663:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d42f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036693:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d42e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751583c expref: 14 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036703:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9a0685800) 00010000:00010000:3.0:1788535940.036706:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535940.036710:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d42e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751583c expref: 14 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.036719:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4a200, rc 0) 00000100:00100000:3.0:1788535940.036771:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+13:11336:x1875415589255296:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 609us (899us total) trans 0 rc 301/301 00000100:00100000:3.0:1788535940.036778:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00080000:0.0:1788535940.036878:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535940.040869:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535940.040973:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589255552 00000100:00100000:2.0:1788535940.040984:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589255552 00000100:00100000:2.0:1788535940.041053:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:2.0:1788535940.041064:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+13:11336:x1875415589255552:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:2.0:1788535940.041119:0:11644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535940.041150:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c2050000/0x74f51638375d3c65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515675 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.041172:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9a0685800) 00010000:00010000:2.0:1788535940.041177:0:11644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535940.041398:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.041414:0:11644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d42bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751582e expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.041428:0:11644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.041474:0:11644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d42bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751582e expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.041488:0:11644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d42bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751582e expref: 5 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.041502:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607087488:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788535940.041603:0:11644:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9920063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535940.047003:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535940.047043:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589255680 00000100:00100000:2.0:1788535940.047052:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589255680 00010000:00010000:2.0:1788535940.047110:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d42bd lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751582e expref: 6 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.047144:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1788535940.047170:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:71ebecc8-0d84-4b23-8d21-de56113948a9+6:2355:x1875415589255680:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535940.047184:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535940.047192:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d42bd lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751582e expref: 6 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.047206:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d42bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751582e expref: 6 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.047238:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9a0685800) 00010000:00010000:2.0:1788535940.047243:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.047252:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.047268:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.047288:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535940.047340:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:71ebecc8-0d84-4b23-8d21-de56113948a9+6:2355:x1875415589255680:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 172us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535940.047347:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00010000:00010000:3.0:1788535940.047697:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d42bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751582e expref: 5 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.047713:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607087488:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788535940.047734:0:11644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.047744:0:11644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.047749:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.047772:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4303 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.047791:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4303 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.047799:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4303 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788535940.048206:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1788535940.052998:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788535940.053017:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.053027:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.053035:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.053051:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535940.053056:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.053064:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.053082:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9a0685800) 00010000:00010000:3.0:1788535940.053085:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535940.053090:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.053097:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d42fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535940.053116:0:11644:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000001d47b7dd reply state 00000000b1a66a1a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4303 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.053125:0:11644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535940.053466:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+14:11336:x1875415589255552:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 12400us (12605us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788535940.053476:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 140 00010000:00010000:3.0:1788535940.058744:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4303 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.058762:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4303 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.058770:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4303 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.058789:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535940.058794:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4303 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.058802:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4303 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.058818:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97a997503d00) 00010000:00010000:3.0:1788535940.058822:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535940.058827:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4303 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.058834:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4303 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.166067:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535940.166106:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589255808 00000100:00100000:1.0:1788535940.166116:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589255808 00000100:00100000:1.0:1788535940.166176:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:1.0:1788535940.166186:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+13:11344:x1875415589255808:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:1.0:1788535940.166217:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535940.166239:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d430a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515843 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.166302:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d4311 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.166317:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d4311 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.166340:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d4311 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535940.166377:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788535940.166381:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535940.166401:0:5832:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d4311 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.166422:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d430a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515843 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.166448:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d4311 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515843 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.166457:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ad000) 00010000:00010000:1.0:1788535940.166460:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535940.166463:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a000, rc 0) 00000100:00100000:1.0:1788535940.166515:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+14:11344:x1875415589255808:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 330us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.166522:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:0.0:1788535940.236583:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535940.236678:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589255936 00000100:00100000:2.0:1788535940.236689:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589255936 00000100:00100000:2.0:1788535940.236749:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:2.0:1788535940.236760:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+14:11350:x1875415589255936:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788535940.236779:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535940.236801:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4318 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751584a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.236867:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d431f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.236917:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d431f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.236930:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d431f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.236963:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4326 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.236971:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4326 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.236978:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4326 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237125:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d432d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237134:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d432d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237140:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d432d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535940.237168:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788535940.237172:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788535940.237191:0:5834:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d432d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237203:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d431f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237210:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d431f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237216:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d431f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237233:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ee00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535940.237237:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d431f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237243:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d431f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237256:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ad000) 00010000:00010000:2.0:1788535940.237259:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535940.237263:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d431f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237269:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d431f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237282:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4326 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237288:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4326 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237293:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4326 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237297:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535940.237299:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4326 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237304:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4326 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237321:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97a99742ab00) 00010000:00010000:2.0:1788535940.237323:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535940.237325:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4326 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237331:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4326 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237364:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4318 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751584a expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237377:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d432d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751584a expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.237385:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:2.0:1788535940.237387:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788535940.237390:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747f800, rc 0) 00000100:00100000:2.0:1788535940.237468:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+15:11350:x1875415589255936:12345-192.168.203.12@tcp:101:bash.0 Request processed in 710us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535940.237476:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:1.0:1788535940.242089:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535940.242184:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589256192 00000100:00100000:3.0:1788535940.242194:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589256192 00000100:00100000:3.0:1788535940.242253:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:3.0:1788535940.242271:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+15:11350:x1875415589256192:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788535940.242291:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535940.242310:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4334 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515851 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.242427:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d433b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.242453:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d433b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.242482:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d433b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.242537:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4342 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.242544:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4342 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.242550:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4342 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788535940.243077:0:11644:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788535940.243234:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.243244:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.243252:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.243287:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d433b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.243294:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d433b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.243301:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d433b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.243307:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535940.243318:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d433b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.243326:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d433b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.243338:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:3.0:1788535940.243341:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535940.243345:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d433b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.243352:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d433b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535940.243365:0:11644:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000709bb100 reply state 00000000da11a94e transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4342 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.243373:0:11644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788535940.243403:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4334 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515851 expref: 18 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.243416:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515851 expref: 17 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.243423:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:3.0:1788535940.243425:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535940.243427:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4bc00, rc 0) 00000100:00100000:3.0:1788535940.243497:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+18:11350:x1875415589256192:12345-192.168.203.12@tcp:101:bash.0 Request processed in 1236us (1416us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788535940.243504:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 143 00010000:00010000:2.0:1788535940.249970:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4342 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.249988:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4342 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.249997:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4342 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.250020:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535940.250025:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4342 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.250045:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4342 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.250064:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a997503d00) 00010000:00010000:2.0:1788535940.250067:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535940.250073:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4342 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.250080:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d4342 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.256822:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535940.256962:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589256320 00000100:00100000:3.0:1788535940.256972:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589256320 00000100:00100000:3.0:1788535940.257049:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1788535940.257060:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+5:2355:x1875415589256320:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788535940.257077:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535940.257097:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4357 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515858 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788535940.257125:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788535940.257145:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=342s v=(0 0) 00010000:00010000:3.0:1788535940.257150:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535940.257160:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4357 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515858 expref: 6 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.257181:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4357 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515858 expref: 6 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.257197:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b600, rc 0) 00000100:00100000:3.0:1788535940.257251:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589256320:12345-192.168.203.12@tcp:101:bash.0 Request processed in 193us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.257274:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00080000:0.0:1788535940.257386:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535940.268853:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535940.268976:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589256448 00000100:00100000:1.0:1788535940.268986:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589256448 00000100:00100000:1.0:1788535940.269047:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:1.0:1788535940.269057:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+6:11350:x1875415589256448:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788535940.269072:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535940.269102:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751585f expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.269133:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4357 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515858 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.269143:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535940.269147:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535940.269152:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.269186:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4357 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515858 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.269199:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4357 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515858 expref: 7 pid: 8424 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.269214:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6673:1875415607087616:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788535940.269321:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a984ed83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535940.272318:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535940.272408:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589256576 00000100:00100000:2.0:1788535940.272419:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589256576 00010000:00010000:2.0:1788535940.272467:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4357 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515858 expref: 8 pid: 8424 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.272682:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:2.0:1788535940.272693:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:2356:x1875415589256576:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535940.272709:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535940.272729:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4357 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515858 expref: 8 pid: 8424 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.272744:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4357 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515858 expref: 8 pid: 8424 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.272783:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535940.272787:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535940.272797:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.272807:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.272845:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.272860:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875415607087744:192.168.203.12@tcp:105: 00000100:00100000:3.0:1788535940.273015:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9920066c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788535940.273179:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4357 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515858 expref: 8 pid: 8424 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.273195:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6673:1875415607087616:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535940.273220:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.273245:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a200, rc 0) 00000100:00100000:1.0:1788535940.273302:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:11350:x1875415589256448:12345-192.168.203.12@tcp:101:bash.0 Request processed in 4246us (4457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.273310:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:0.0:1788535940.282394:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535940.282508:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875415607087744:192.168.203.12@tcp:105: 00010000:00010000:3.0:1788535940.282533:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535940.282596:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589256576:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 9904us (10286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.282619:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:1.0:1788535940.283710:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589256832 00000100:00100000:1.0:1788535940.283721:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589256832 00000100:00100000:1.0:1788535940.283778:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:1.0:1788535940.283787:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+17:11350:x1875415589256832:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:1.0:1788535940.284160:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+18:11350:x1875415589256832:12345-192.168.203.12@tcp:35:bash.0 Request processed in 363us (1765us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788535940.284168:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:0.0:1788535940.386155:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535940.386254:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589257088 00000100:00100000:1.0:1788535940.386264:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589257088 00000100:00100000:1.0:1788535940.386320:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:1.0:1788535940.386331:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+18:11360:x1875415589257088:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788535940.386359:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535940.386379:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d4365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515866 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535940.386477:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788535940.386597:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d4365 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515866 expref: 20 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.386610:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ad000) 00010000:00010000:1.0:1788535940.386626:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788535940.386633:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d4365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515866 expref: 20 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.386646:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0bc00, rc 0) 00000100:00100000:1.0:1788535940.386708:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+19:11360:x1875415589257088:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 379us (562us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1788535940.386716:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:0.0:1788535940.389750:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535940.389875:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589257344 00000100:00100000:2.0:1788535940.389908:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589257344 00000100:00100000:2.0:1788535940.389959:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1788535940.389969:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+19:11360:x1875415589257344:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788535940.390322:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+20:11360:x1875415589257344:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 353us (579us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788535940.390331:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1788535940.467781:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535940.468037:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589257472 00000100:00100000:0.0:1788535940.468047:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589257472 00000100:00100000:1.0:1788535940.468315:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:1.0:1788535940.468327:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+20:11366:x1875415589257472:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788535940.468349:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535940.468368:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d4373 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751586d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.468442:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d437a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.468457:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d437a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.468469:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d437a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535940.468502:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788535940.468506:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535940.468523:0:5834:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d437a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.468548:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d4373 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751586d expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.468583:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d437a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751586d expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.468593:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:1.0:1788535940.468596:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535940.468599:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0ba00, rc 0) 00000100:00100000:1.0:1788535940.468660:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+21:11366:x1875415589257472:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 335us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.468667:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:0.0:1788535940.472321:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535940.473481:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589257728 00000100:00100000:1.0:1788535940.473496:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589257728 00000100:00100000:1.0:1788535940.473572:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:1.0:1788535940.473583:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+21:11366:x1875415589257728:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788535940.473602:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535940.473623:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4381 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515874 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.473718:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4388 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.473733:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.473744:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535940.473755:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788535940.473919:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4381 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515874 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.473939:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515874 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.473947:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:1.0:1788535940.473950:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535940.473954:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0b800, rc 0) 00000100:00100000:1.0:1788535940.474020:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+23:11366:x1875415589257728:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 439us (1708us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788535940.474028:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:0.0:1788535940.477481:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535940.477560:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589257984 00000100:00100000:3.0:1788535940.477570:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589257984 00000100:00100000:3.0:1788535940.477622:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:3.0:1788535940.477632:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+23:11366:x1875415589257984:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535940.477651:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535940.477669:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4396 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751587b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.477768:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d439d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.477781:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d439d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.477791:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d439d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535940.477802:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788535940.477936:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4396 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751587b expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.477952:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d439d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751587b expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.477960:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:3.0:1788535940.477963:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788535940.477966:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b800, rc 0) 00000100:00100000:3.0:1788535940.478019:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+25:11366:x1875415589257984:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 388us (549us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788535940.478025:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:2.0:1788535940.491472:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535940.491507:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535940.491677:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589258112 00000100:00100000:3.0:1788535940.491687:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589258112 00000100:00100000:3.0:1788535940.491752:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:3.0:1788535940.491762:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+6:2358:x1875415589258112:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:3.0:1788535940.491802:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.491821:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 6 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.491830:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535940.491834:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535940.491839:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.491875:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 6 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.491921:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 6 pid: 6673 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.491935:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b930ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8424:1875415607087872:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535940.492018:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fe000 going to sleep for 11 seconds 00000100:00100000:0.0:1788535940.492525:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589258240 00000100:00100000:0.0:1788535940.492532:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589258240 00000100:00100000:0.0:1788535940.492580:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788535940.492589:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+25:2358:x1875415589258240:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535940.492600:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535940.492620:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4388 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515874 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.492637:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:0.0:1788535940.492642:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535940.492687:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+24:2358:x1875415589258240:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 99us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535940.492694:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788535940.497032:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535940.497129:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b930ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8424:1875415607087872:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788535940.497157:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535940.501372:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589258368 00000100:00100000:0.0:1788535940.501388:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589258368 00002000:00100000:0.0:1788535940.501457:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97a9b91c0700 x1875415589258368/t0(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:596/0 lens 504/0 e 0 to 0 dl 1788535951 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535940.501485:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b91c0700 with x1875415589258368 ext(0->12) 00010000:00010000:0.0:1788535940.501496:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 7 pid: 6673 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.501514:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 7 pid: 6673 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535940.501522:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97a9b91c0700 00000100:00100000:0.0:1788535940.501547:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1788535940.501555:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:30a1922d-0d3f-4681-a966-cec3672631c6+7:2357:x1875415589258368:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:0.0:1788535940.507535:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:30a1922d-0d3f-4681-a966-cec3672631c6+9:2357:x1875415589258368:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 5966us (10496us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788535940.507550:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00002000:00100000:0.0:1788535940.507565:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97a9b91c0700 x1875415589258368/t4294967305(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:596/0 lens 504/448 e 0 to 0 dl 1788535951 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535940.507577:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b91c0700 with x1875415589258368 ext(0->12) 00010000:00010000:0.0:1788535940.507589:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 9 pid: 6673 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.507612:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 9 pid: 6673 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535940.507621:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97a9b91c0700 00000100:00100000:3.0:1788535940.517803:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535940.517876:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589258496 00000100:00100000:0.0:1788535940.517926:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589258496 00010000:00010000:0.0:1788535940.517971:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 9 pid: 6673 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535940.518013:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1788535940.518024:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+9:2358:x1875415589258496:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535940.518038:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788535940.518058:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788535940.518061:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788535940 00002000:00010000:0.0:1788535940.518064:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788535940 00002000:00010000:0.0:1788535940.518066:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788535940 00010000:00010000:0.0:1788535940.518072:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 9 pid: 6673 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.518087:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 9 pid: 6673 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.518110:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d435e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751585f expref: 9 pid: 6673 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.518128:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788535940.518145:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788535940.518151:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.518161:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.518205:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535940.521180:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.521218:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.521253:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.521262:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.521270:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.521278:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1455530) 00010000:00010000:2.0:1788535940.521282:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.521301:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.521320:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.521327:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d43ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535940.521770:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+8:2358:x1875415589258496:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 3740us (3971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535940.521781:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1788535940.523041:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+7:2358:x1875415589258112:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 31272us (31570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535940.523054:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:0.0:1788535940.525161:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535940.525226:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589258752 00000100:00100000:2.0:1788535940.525236:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589258752 00000100:00100000:2.0:1788535940.525283:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:2.0:1788535940.525306:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99c788050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+24:11366:x1875415589258752:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:2.0:1788535940.525366:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d439d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751587b expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535940.525611:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788535940.525655:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788535940.526288:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788535940.526346:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.526362:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4349 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515851 expref: 28 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.526372:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.526407:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515851 expref: 28 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.526422:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4349 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515851 expref: 28 pid: 11644 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.526463:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875415607088000:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788535940.526550:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a992006e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535940.529523:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535940.529840:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589258880 00000100:00100000:0.0:1788535940.529850:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589258880 00010000:00010000:0.0:1788535940.529932:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4349 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515851 expref: 29 pid: 11644 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535940.529979:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:0.0:1788535940.529990:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+29:2355:x1875415589258880:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535940.530006:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535940.530013:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4349 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515851 expref: 29 pid: 11644 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.530027:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4349 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515851 expref: 29 pid: 11644 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.530049:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:0.0:1788535940.530054:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.530064:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.530072:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.530101:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535940.530154:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+29:2355:x1875415589258880:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 166us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535940.530162:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00010000:00010000:2.0:1788535940.532386:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4349 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515851 expref: 28 pid: 11644 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.532413:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875415607088000:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535940.532446:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.532456:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.532462:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535940.532590:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788535940.539012:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788535940.539162:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607088128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788535940.539231:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535940.539258:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a992006b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535940.540755:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607088128 00000100:00100000:0.0:1788535940.540768:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607088128 00000100:00100000:0.0:1788535940.540930:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788535940.540940:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875415607088128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788535940.541039:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875415607088128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 101us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535940.541059:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788535940.541517:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607088128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788535940.542115:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788535940.542208:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9309880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607088256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788535940.542259:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535940.542280:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535940.542426:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607088256 00000100:00100000:0.0:1788535940.542441:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607088256 00000100:00100000:0.0:1788535940.542475:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788535940.542482:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875415607088256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788535940.542653:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875415607088256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 170us (393us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788535940.542661:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788535940.543239:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9309880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607088256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788535940.543679:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788535940.543729:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.543740:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.543747:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.543753:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ea00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535940.543757:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.543764:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.543796:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:3.0:1788535940.543799:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788535940.543804:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.543811:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d43b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788535940.544040:0:5836:0:(mdd_object.c:4338:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788535940.544357:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788535940.544374:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342675485696ns, next at 343675482875ns, rc = 0 00000001:00080000:3.0:1788535940.544381:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788535940.544416:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:3.0:1788535940.544419:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788535940.544427:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d439d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751587b expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.544754:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99c788050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+31:11366:x1875415589258752:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 19461us (19600us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788535940.544763:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000020:00080000:3.0:1788535940.544767:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1788535940.544869:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535940.546869:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535940.546999:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589259008 00000100:00100000:1.0:1788535940.547007:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589259008 00000100:00100000:1.0:1788535940.547068:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:1.0:1788535940.547078:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+31:11366:x1875415589259008:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788535940.547098:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535940.547118:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d43b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515882 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.547185:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d43b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515882 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.547201:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d43b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515882 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.547219:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:1.0:1788535940.547235:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788535940.547238:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0be00, rc 0) 00000100:00100000:1.0:1788535940.547297:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+32:11366:x1875415589259008:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 220us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.547305:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:0.0:1788535940.551146:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535940.551236:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589259264 00000100:00100000:1.0:1788535940.551246:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589259264 00000100:00100000:1.0:1788535940.551305:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788535940.551316:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+32:11366:x1875415589259264:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788535940.551546:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+33:11366:x1875415589259264:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 231us (407us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788535940.551553:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788535940.640404:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535940.640561:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589259520 00000100:00100000:3.0:1788535940.640572:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589259520 00000100:00100000:3.0:1788535940.640628:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:3.0:1788535940.640639:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+33:11376:x1875415589259520:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535940.640662:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535940.640696:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d43c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515889 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535940.640784:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788535940.641066:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d43c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515889 expref: 35 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.641081:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ad000) 00010000:00010000:3.0:1788535940.641084:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535940.641090:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d43c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515889 expref: 35 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.641104:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b800, rc 0) 00000100:00100000:3.0:1788535940.641233:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+34:11376:x1875415589259520:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 595us (838us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788535940.641241:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:2.0:1788535940.644333:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535940.644488:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589259648 00000100:00100000:3.0:1788535940.644498:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589259648 00000100:00100000:3.0:1788535940.644567:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:3.0:1788535940.644577:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+34:11376:x1875415589259648:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:3.0:1788535940.644648:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d43ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.644664:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d43ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.644676:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d43ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.644863:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d43d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.644875:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d43d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.644882:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d43d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645063:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d43dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645071:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d43dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645079:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d43dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535940.645117:0:11644:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d43dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645129:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d43ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645135:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d43ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645141:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d43ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645147:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4ac00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535940.645478:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d43ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645497:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d43ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645510:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:3.0:1788535940.645513:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535940.645518:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d43ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645524:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d43ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645538:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d43d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645544:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d43d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645683:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d43d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645692:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4bc00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535940.645695:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d43d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645702:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d43d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.645996:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a997503300) 00010000:00010000:3.0:1788535940.646000:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535940.646004:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d43d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.646023:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d43d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.646043:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d43dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.646050:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d43dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.646056:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d43dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.646061:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535940.646065:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d43dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.646072:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d43dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.646080:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:3.0:1788535940.646083:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535940.646086:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d43dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.646092:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d43dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.646600:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+34:11376:x1875415589259648:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 2018us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.646611:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:0.0:1788535940.650080:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535940.650253:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589259904 00000100:00100000:1.0:1788535940.650264:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589259904 00000100:00100000:0.0:1788535940.650503:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788535940.650515:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+34:11376:x1875415589259904:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788535940.650765:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+35:11376:x1875415589259904:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 252us (694us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788535940.650792:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788535940.690000:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535940.690082:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589260160 00000100:00100000:1.0:1788535940.690092:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589260160 00000100:00100000:1.0:1788535940.690156:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:1.0:1788535940.690167:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+35:11379:x1875415589260160:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788535940.690192:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535940.690212:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d43e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515890 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.690291:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d43ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.690306:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d43ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.690317:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d43ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.690345:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d43f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.690366:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d43f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.690373:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d43f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.690504:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d43f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.690513:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d43f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.690520:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d43f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535940.690529:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788535940.691094:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d43ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691104:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d43ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691110:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d43ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691115:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535940.691118:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d43ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691136:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d43ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691148:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:1.0:1788535940.691151:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535940.691156:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d43ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691162:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d43ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691175:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d43f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691181:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d43f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691186:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d43f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691191:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535940.691194:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d43f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691199:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d43f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691205:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a9888ad900) 00010000:00010000:1.0:1788535940.691207:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535940.691209:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d43f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691224:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d43f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691264:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d43e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515890 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691275:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d43f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515890 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.691282:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:1.0:1788535940.691285:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535940.691288:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0ac00, rc 0) 00000100:00100000:1.0:1788535940.691395:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+37:11379:x1875415589260160:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1230us (1405us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788535940.691403:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:2.0:1788535940.702039:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535940.702103:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589260288 00000100:00100000:3.0:1788535940.702112:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589260288 00000100:00100000:3.0:1788535940.702172:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:3.0:1788535940.702182:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+37:11379:x1875415589260288:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1788535940.702247:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4406 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.702264:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.702276:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.702302:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.702309:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4406 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.702316:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.702322:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535940.702326:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.702333:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4406 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.702343:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:3.0:1788535940.702347:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535940.702974:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4406 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.702993:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4406 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.703119:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+37:11379:x1875415589260288:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 937us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.703127:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:0.0:1788535940.708282:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535940.708428:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589260544 00000100:00100000:3.0:1788535940.708446:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589260544 00000100:00100000:3.0:1788535940.708534:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:3.0:1788535940.708544:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+37:11379:x1875415589260544:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788535940.708848:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+38:11379:x1875415589260544:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 304us (574us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788535940.708857:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00010000:00010000:3.0:1788535941.005107:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535941.043775:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535941.043879:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589260800 00000100:00100000:3.0:1788535941.043911:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589260800 00000100:00100000:3.0:1788535941.044018:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:3.0:1788535941.044028:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+38:11410:x1875415589260800:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:3.0:1788535941.044052:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535941.044071:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d440d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515897 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.044201:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4414 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.044215:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.044234:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535941.044246:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788535941.044365:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d440d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515897 expref: 41 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.044381:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515897 expref: 40 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.044390:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:3.0:1788535941.044393:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535941.044396:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4bc00, rc 0) 00000100:00100000:3.0:1788535941.044500:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+40:11410:x1875415589260800:12345-192.168.203.12@tcp:101:cat.0 Request processed in 472us (734us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788535941.044507:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:2.0:1788535941.051905:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535941.051957:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535941.052147:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589261184 00000100:00100000:3.0:1788535941.052157:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589261184 00000100:00100000:3.0:1788535941.052224:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788535941.052233:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+40:2358:x1875415589261184:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535941.052249:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535941.052272:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4414 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515897 expref: 40 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.052291:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:3.0:1788535941.052296:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535941.052364:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+39:2358:x1875415589261184:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 132us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535941.052371:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1788535941.053513:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589261056 00000100:00100000:0.0:1788535941.053523:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589261056 00000100:00100000:0.0:1788535941.053580:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:0.0:1788535941.053602:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+39:11410:x1875415589261056:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:0.0:1788535941.053841:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+40:11410:x1875415589261056:12345-192.168.203.12@tcp:35:cat.0 Request processed in 251us (1967us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788535941.053850:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1788535941.201769:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535941.202225:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589261440 00000100:00100000:1.0:1788535941.202239:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589261440 00000100:00100000:1.0:1788535941.202321:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:1.0:1788535941.202333:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+40:11416:x1875415589261440:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1788535941.202365:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535941.202368:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788535941.202407:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d437a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751586d expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535941.202443:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:1.0:1788535941.202450:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535941.202486:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d4422 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751589e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535941.202617:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535941.202643:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d43f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515890 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535941.202653:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535941.202693:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d43f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515890 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535941.202708:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d43f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515890 expref: 40 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535941.202724:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f14380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607088384:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788535941.203368:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a984ed80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535941.224181:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f14380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607088384:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535941.224238:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535941.229222:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535941.230999:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589261568 00000100:00100000:0.0:1788535941.231020:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589261568 00010000:00010000:0.0:1788535941.243380:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d43f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515890 expref: 41 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535941.243443:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:0.0:1788535941.243466:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+41:2356:x1875415589261568:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535941.243482:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535941.243490:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d43f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515890 expref: 41 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.243504:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d43f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515890 expref: 41 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.243527:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d43f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515890 expref: 41 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.243559:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:0.0:1788535941.243565:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.243574:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.243582:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.243622:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535941.243692:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+40:2356:x1875415589261568:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 239us (14486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535941.243699:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00010000:00010000:2.0:1788535941.247624:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.247642:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535941.247666:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788535941.247919:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d4422 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751589e expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.247943:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751589e expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.247953:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:2.0:1788535941.247956:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788535941.247959:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0b400, rc 0) 00000100:00100000:2.0:1788535941.248025:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+40:11416:x1875415589261440:12345-192.168.203.12@tcp:101:dd.0 Request processed in 45693us (46282us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788535941.248034:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:2.0:1788535941.256981:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535941.257069:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589261824 00000100:00100000:3.0:1788535941.257080:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589261824 00000100:00100000:3.0:1788535941.257153:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:3.0:1788535941.257165:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+40:11416:x1875415589261824:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:3.0:1788535941.257496:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4437 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.257515:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.257527:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535941.257585:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788535941.257610:0:5833:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000004c54287d reply state 000000009567b1cd transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535941.257619:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535941.257713:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+43:11416:x1875415589261824:12345-192.168.203.12@tcp:36:dd.0 Request processed in 550us (741us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788535941.257721:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 155 00000020:00080000:3.0:1788535941.257726:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788535941.266582:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.266600:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4437 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.266628:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4437 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.266634:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4bc00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535941.266639:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4437 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.266646:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4437 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.266728:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:3.0:1788535941.266733:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535941.266738:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4437 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.266744:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4437 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535941.677653:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535941.677804:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589261952 00000100:00100000:0.0:1788535941.677816:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589261952 00000100:00100000:0.0:1788535941.677927:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:0.0:1788535941.677940:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+42:11430:x1875415589261952:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:0.0:1788535941.677969:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535941.677994:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d443e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975158a5 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.678256:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4445 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.678272:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4445 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.678436:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4445 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.678454:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d444c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.678462:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d444c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.678469:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d444c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.678597:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4453 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.678609:0:11644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751589e expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.678742:0:11644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4453 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.678925:0:11644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751589e expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.678940:0:11644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751589e expref: 43 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535941.678954:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607088512:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535941.679099:0:11644:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98a6eba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535941.687795:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535941.687872:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589262208 00000100:00100000:3.0:1788535941.687882:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589262208 00000100:00100000:0.0:1788535941.687932:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607088512:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535941.687953:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00010000:00010000:0.0:1788535941.687961:0:11644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4453 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535941.687962:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+44:5593:x1875415589262208:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788535941.688350:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+45:5593:x1875415589262208:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 387us (563us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788535941.688359:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788535941.690574:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535941.691189:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589262336 00000100:00100000:2.0:1788535941.691201:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589262336 00010000:00010000:2.0:1788535941.691245:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751589e expref: 45 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535941.691344:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:2.0:1788535941.691355:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+45:2355:x1875415589262336:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535941.691370:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535941.691391:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751589e expref: 45 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.691406:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751589e expref: 45 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.691439:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b400/0x74f51638375d4429 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751589e expref: 45 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.691455:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:2.0:1788535941.691460:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4453 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.691470:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.691476:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4453 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.691507:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788535941.691560:0:11644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535941.691569:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+44:2355:x1875415589262336:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 216us (1004us total) trans 0 rc 0/0 00010000:00010000:0.0:1788535941.691569:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535941.691576:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000004:00200000:0.0:1788535941.691614:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788535941.691618:0:11644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535941.691641:0:11644:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.691653:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.691662:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4445 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.691669:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4445 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.691675:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4445 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.691680:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535941.691684:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4445 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.691692:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4445 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.691836:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:0.0:1788535941.691839:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535941.691844:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4445 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.691850:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4445 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.691861:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d444c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.691867:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d444c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.691872:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d444c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.691877:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535941.691879:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d444c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.691884:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d444c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.693468:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a9a0685300) 00010000:00010000:0.0:1788535941.693473:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535941.693480:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d444c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.693487:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d444c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.693569:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecaa00/0x74f51638375d443e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158a5 expref: 44 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.693584:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158a5 expref: 43 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.693591:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:0.0:1788535941.693592:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535941.693595:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987eca000, rc 0) 00000100:00100000:0.0:1788535941.693670:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+43:11430:x1875415589261952:12345-192.168.203.12@tcp:101:stat.0 Request processed in 15733us (16027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535941.693679:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:3.0:1788535941.775242:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535941.775388:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589262592 00000100:00100000:2.0:1788535941.775400:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589262592 00000100:00100000:2.0:1788535941.775473:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:2.0:1788535941.775483:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+43:11436:x1875415589262592:12345-192.168.203.12@tcp:36:truncate.0 00010000:00010000:2.0:1788535941.775545:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535941.775573:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca000/0x74f51638375d4453 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158a5 expref: 43 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.775599:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:2.0:1788535941.775604:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535941.775826:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d445a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.775839:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d445a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.775848:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d445a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535941.775953:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788535941.775978:0:5834:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000a6a789a1 reply state 0000000092b98fcb transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d445a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535941.775987:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788535941.776079:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+45:11436:x1875415589262592:12345-192.168.203.12@tcp:36:truncate.0 Request processed in 596us (849us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788535941.776086:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 157 00000020:00080000:2.0:1788535941.776091:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788535941.782489:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d445a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.782507:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d445a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.782514:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d445a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.782520:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ea00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535941.782540:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d445a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.782548:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d445a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.782564:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:2.0:1788535941.782567:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535941.782571:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d445a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.782578:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d445a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535941.901288:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535941.901606:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607088768:0@lo:400:kworker.0 00000100:00100000:0.0:1788535941.901675:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535941.901750:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535941.901756:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607088896:0@lo:400:kworker.0 00000100:00100000:0.0:1788535941.901780:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535941.901826:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607088768 00000100:00100000:0.0:1788535941.901834:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607088768 00000100:00100000:0.0:1788535941.901870:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607088896 00000100:00100000:0.0:1788535941.901872:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607088896 00000100:00100000:0.0:1788535941.901932:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788535941.901941:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607088768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535941.901991:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607088768:12345-0@lo:400:kworker.0 Request processed in 51us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535941.901998:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788535941.902023:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788535941.902029:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607088896:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788535941.902290:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535941.903413:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607088896:12345-0@lo:400:kworker.0 Request processed in 1377us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535941.903434:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788535941.903499:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607088896:0@lo:400:kworker.0 00000100:00100000:0.0:1788535941.903512:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607088768:0@lo:400:kworker.0 00000100:00100000:3.0:1788535941.904471:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607089024:0@lo:400:kworker.0 00000100:00100000:3.0:1788535941.904525:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535941.904563:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a986f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607088640:0@lo:400:kworker.0 00000100:00100000:3.0:1788535941.904592:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535941.904722:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607089024 00000100:00100000:2.0:1788535941.904730:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607089024 00000100:00100000:2.0:1788535941.904781:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788535941.904789:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875415607089024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535941.904836:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875415607089024:12345-0@lo:400:kworker.0 Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535941.904842:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788535941.905032:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607089024:0@lo:400:kworker.0 00000100:00100000:0.0:1788535941.905227:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607088640 00000100:00100000:0.0:1788535941.905232:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607088640 00000100:00100000:0.0:1788535941.905269:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788535941.905277:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607088640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535941.905450:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a986f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea5d41c9-12b3-443f-877d-8b3d703772fc:3308:1875415607088640:0@lo:400:kworker.0 00000100:00100000:0.0:1788535941.905487:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3308:x1875415607088640:12345-0@lo:400:kworker.0 Request processed in 52us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535941.905496:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788535941.907275:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607089152:0@lo:400:kworker.0 00000100:00100000:0.0:1788535941.907333:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535941.907500:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607089280:0@lo:400:kworker.0 00000100:00100000:1.0:1788535941.907539:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535941.907590:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607089280 00000100:00100000:1.0:1788535941.907597:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607089280 00000100:00100000:1.0:1788535941.907646:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788535941.907669:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607089280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535941.907730:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607089280:12345-0@lo:400:kworker.0 Request processed in 63us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535941.907737:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788535941.907779:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607089280:0@lo:400:kworker.0 00000100:00080000:2.0:1788535941.908359:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535941.909825:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607089152 00000100:00100000:3.0:1788535941.909838:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607089152 00000100:00080000:2.0:1788535941.909985:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535941.910202:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788535941.910215:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875415607089152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535941.910311:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875415607089152:12345-0@lo:400:kworker.0 Request processed in 100us (2977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535941.910318:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788535941.910486:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607089152:0@lo:400:kworker.0 00000100:00100000:3.0:1788535941.978911:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535941.979239:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589262720 00000100:00100000:2.0:1788535941.979262:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589262720 00000100:00100000:2.0:1788535941.979326:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:2.0:1788535941.979336:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+44:11450:x1875415589262720:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:2.0:1788535941.979484:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535941.979505:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4461 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975158ac expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979583:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4468 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979598:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979611:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979626:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d446f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979633:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d446f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979639:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d446f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979738:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4476 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979747:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979754:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535941.979797:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788535941.979802:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788535941.979830:0:5834:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979842:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979850:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979856:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4468 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979862:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4468 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979867:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535941.979871:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4468 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.979878:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4468 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.980458:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:2.0:1788535941.980464:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535941.980468:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4468 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.980477:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4468 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.980506:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d446f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.980513:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d446f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.980519:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d446f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.980525:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ee00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535941.980528:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d446f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.980534:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d446f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.980544:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a99742ab00) 00010000:00010000:2.0:1788535941.980546:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535941.980549:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d446f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.980554:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d446f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.980590:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4461 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ac expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.980605:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ac expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.980623:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:2.0:1788535941.980625:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535941.980628:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747fe00, rc 0) 00000100:00100000:2.0:1788535941.980765:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+45:11450:x1875415589262720:12345-192.168.203.12@tcp:101:stat.0 Request processed in 1429us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535941.980773:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:3.0:1788535942.012222:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535942.012269:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535942.012318:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.012456:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589262848 00000100:00100000:2.0:1788535942.012467:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589262848 00000100:00100000:2.0:1788535942.012519:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 286 00000100:00100000:2.0:1788535942.012530:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2356:x1875415589262848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535942.012605:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2356:x1875415589262848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.012613:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 286 00000100:00100000:3.0:1788535942.013247:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.014018:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589263232 00000100:00100000:2.0:1788535942.014029:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589263232 00000100:00100000:2.0:1788535942.014093:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:2.0:1788535942.014103:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589263232:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535942.014162:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2356:x1875415589263232:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 61us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.014170:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00080000:3.0:1788535942.014703:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535942.018617:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589263104 00000100:00100000:0.0:1788535942.018634:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589263104 00000100:00100000:0.0:1788535942.018714:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589262976 00000100:00100000:0.0:1788535942.018718:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589262976 00000100:00100000:0.0:1788535942.018743:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:0.0:1788535942.018752:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589263104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535942.018826:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+6:2356:x1875415589263104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (6556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.018849:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:0.0:1788535942.018868:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:0.0:1788535942.018874:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b74d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2356:x1875415589262976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535942.018924:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b74d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2356:x1875415589262976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 49us (6605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.018929:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00080000:3.0:1788535942.019058:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535942.019062:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788535942.030248:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535942.100373:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.100552:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589263488 00000100:00100000:2.0:1788535942.100563:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589263488 00000100:00100000:2.0:1788535942.100654:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:2.0:1788535942.100665:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+45:11461:x1875415589263488:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788535942.100715:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535942.100739:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d447d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975158b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535942.100842:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788535942.101003:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d447d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158b3 expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.101019:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ad000) 00010000:00010000:2.0:1788535942.101022:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788535942.101027:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d447d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158b3 expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.101041:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747f000, rc 0) 00000100:00100000:2.0:1788535942.101354:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+46:11461:x1875415589263488:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 690us (989us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788535942.101362:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00080000:3.0:1788535942.102938:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535942.105006:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535942.105461:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589263744 00000100:00100000:3.0:1788535942.105474:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589263744 00000100:00100000:3.0:1788535942.105541:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:3.0:1788535942.105551:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99c788c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+46:11461:x1875415589263744:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788535942.106452:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99c788c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+47:11461:x1875415589263744:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 898us (1450us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788535942.106461:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1788535942.175838:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.176084:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589264000 00000100:00100000:2.0:1788535942.176094:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589264000 00000100:00100000:2.0:1788535942.176161:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:2.0:1788535942.176171:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+47:11467:x1875415589264000:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788535942.176195:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535942.176217:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d448b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975158ba expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.176447:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.176476:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4476 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ac expref: 48 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.176488:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.176527:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ac expref: 48 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.176540:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ac expref: 48 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535942.176554:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607089408:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788535942.176710:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9920063c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535942.189571:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607089408:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535942.189605:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535942.191501:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535942.191880:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589264128 00000100:00100000:0.0:1788535942.191923:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589264128 00010000:00010000:0.0:1788535942.191964:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ac expref: 49 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535942.192046:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:0.0:1788535942.192056:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+49:2356:x1875415589264128:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535942.192071:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535942.192080:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ac expref: 49 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.192094:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ac expref: 49 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.192116:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ac expref: 49 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.192145:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:0.0:1788535942.192151:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.192160:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.192167:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.192202:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535942.192261:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+48:2356:x1875415589264128:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 206us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.192269:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00010000:00010000:2.0:1788535942.192338:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.192347:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535942.192368:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788535942.192546:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d448b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ba expref: 49 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.192561:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ba expref: 48 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.192569:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:2.0:1788535942.192578:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788535942.192581:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747ee00, rc 0) 00000100:00100000:2.0:1788535942.192608:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+48:11467:x1875415589264000:12345-192.168.203.12@tcp:101:bash.0 Request processed in 16439us (16781us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788535942.192615:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:2.0:1788535942.197287:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535942.197435:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589264384 00000100:00100000:3.0:1788535942.197458:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589264384 00000100:00100000:3.0:1788535942.197515:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 161 00000100:00100000:3.0:1788535942.197525:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+48:11467:x1875415589264384:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:3.0:1788535942.197804:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d44a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.197822:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d44a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.197846:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d44a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535942.197938:0:11644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788535942.197964:0:11644:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000e29e352d reply state 00000000aa66a02e transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d44a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535942.197974:0:11644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535942.198062:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+51:11467:x1875415589264384:12345-192.168.203.12@tcp:36:bash.0 Request processed in 537us (792us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788535942.198070:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 161 00000020:00080000:3.0:1788535942.198075:0:11644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788535942.208826:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d44a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.208846:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d44a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.208854:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d44a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.208860:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535942.208865:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d44a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.208873:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d44a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.209020:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:1.0:1788535942.209024:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535942.209029:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d44a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.209036:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d44a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535942.212554:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535942.212625:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589264512 00000100:00100000:0.0:1788535942.212634:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589264512 00000100:00100000:0.0:1788535942.212705:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:0.0:1788535942.212715:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+50:11467:x1875415589264512:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788535942.212739:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535942.212760:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d44a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975158c1 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.212842:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d44ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.212857:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ba expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.212883:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d44ae lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.212954:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ba expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.212967:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ba expref: 51 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535942.212982:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6697:1875415607089536:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535942.213052:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98a6eb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788535942.216194:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535942.216381:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589264640 00000100:00100000:1.0:1788535942.216389:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589264640 00010000:00010000:1.0:1788535942.216433:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ba expref: 52 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535942.216462:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:1.0:1788535942.216470:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+52:2356:x1875415589264640:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535942.216482:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535942.216489:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ba expref: 52 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.216501:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ba expref: 52 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.216521:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:1.0:1788535942.216527:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d44ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.216537:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d44ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.216545:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d44ae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.216563:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535942.216616:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+52:2356:x1875415589264640:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 146us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535942.216624:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00010000:00010000:0.0:1788535942.216867:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4492 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158ba expref: 51 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535942.216883:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6697:1875415607089536:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535942.216946:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d44ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.216955:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d44ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.216960:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d44ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535942.217006:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788535942.217011:0:6697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535942.217032:0:6697:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d44ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.217073:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d44a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158c1 expref: 51 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.217087:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d44ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158c1 expref: 50 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.217094:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:0.0:1788535942.217096:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535942.217099:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecb400, rc 0) 00000100:00100000:0.0:1788535942.217124:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+50:11467:x1875415589264512:12345-192.168.203.12@tcp:101:bash.0 Request processed in 4412us (4579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.217131:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:1.0:1788535942.225504:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535942.225603:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589264896 00000100:00100000:0.0:1788535942.225613:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589264896 00000100:00100000:0.0:1788535942.225672:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1788535942.225682:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+50:11467:x1875415589264896:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:0.0:1788535942.225953:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+51:11467:x1875415589264896:12345-192.168.203.12@tcp:35:bash.0 Request processed in 271us (458us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788535942.225962:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:3.0:1788535942.299047:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.299191:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589265152 00000100:00100000:2.0:1788535942.299200:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589265152 00000100:00100000:2.0:1788535942.299258:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:2.0:1788535942.299268:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+51:11477:x1875415589265152:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788535942.299291:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535942.299310:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d44b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975158c8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535942.299401:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788535942.299527:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d44b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158c8 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.299541:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ad000) 00010000:00010000:2.0:1788535942.299544:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788535942.299549:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d44b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158c8 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.299565:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747f000, rc 0) 00000100:00100000:2.0:1788535942.299629:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+52:11477:x1875415589265152:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 361us (589us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788535942.299653:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:1.0:1788535942.303004:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.303128:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589265280 00000100:00100000:2.0:1788535942.303137:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589265280 00000100:00100000:2.0:1788535942.303204:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:2.0:1788535942.303215:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+52:11477:x1875415589265280:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1788535942.303290:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d44c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303306:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d44c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303318:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d44c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303331:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d44ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303338:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d44ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303345:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d44ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303445:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d44d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303454:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d44d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303461:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d44d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535942.303521:0:5833:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d44d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303535:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d44c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303541:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d44c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303547:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d44c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303553:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ea00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535942.303557:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d44c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303564:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d44c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303576:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:2.0:1788535942.303579:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535942.303584:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d44c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303591:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d44c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303603:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d44ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303609:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d44ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303621:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d44ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303627:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ee00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535942.303630:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d44ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303636:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d44ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303646:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a99742ab00) 00010000:00010000:2.0:1788535942.303648:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535942.303651:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d44ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303657:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d44ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303671:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d44d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303676:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d44d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303682:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d44d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303687:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535942.303689:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d44d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303705:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d44d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303712:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:2.0:1788535942.303714:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535942.303717:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d44d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.303723:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d44d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535942.303797:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+52:11477:x1875415589265280:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 583us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.303806:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:1.0:1788535942.306702:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535942.306801:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589265536 00000100:00100000:0.0:1788535942.306810:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589265536 00000100:00100000:0.0:1788535942.306865:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1788535942.306875:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+52:11477:x1875415589265536:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788535942.307161:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+53:11477:x1875415589265536:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 287us (469us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788535942.307186:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788535942.355690:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535942.355881:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589265792 00000100:00100000:0.0:1788535942.355933:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589265792 00000100:00100000:0.0:1788535942.356015:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:0.0:1788535942.356026:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+53:11480:x1875415589265792:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535942.356049:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535942.356090:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d44d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975158cf expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356170:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d44df lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356185:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d44df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356197:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d44df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356210:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d44e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356216:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d44e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356222:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d44e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356347:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d44ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356374:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d44ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356381:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d44ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535942.356393:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788535942.356508:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d44df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356516:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d44df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356523:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d44df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356528:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535942.356533:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d44df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356540:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d44df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356552:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:0.0:1788535942.356554:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535942.356559:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d44df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356566:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d44df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356578:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d44e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356589:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d44e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356595:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d44e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356600:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535942.356603:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d44e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356608:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d44e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356616:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a9a0685300) 00010000:00010000:0.0:1788535942.356618:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535942.356621:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d44e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356627:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d44e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356664:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d44d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158cf expref: 56 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356677:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d44ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158cf expref: 55 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.356684:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:0.0:1788535942.356686:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535942.356693:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecbe00, rc 0) 00000100:00100000:0.0:1788535942.357124:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+55:11480:x1875415589265792:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1096us (1440us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788535942.357134:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:1.0:1788535942.363959:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535942.364074:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589265920 00000100:00100000:3.0:1788535942.364083:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589265920 00000100:00100000:3.0:1788535942.364155:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:3.0:1788535942.364165:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+55:11480:x1875415589265920:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1788535942.364230:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d44fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.364260:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d44fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.364271:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d44fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.364300:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d44fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.364307:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d44fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.364314:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d44fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.364320:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4bc00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535942.364324:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d44fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.364331:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d44fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.364342:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:3.0:1788535942.364345:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535942.364350:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d44fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.364356:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d44fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535942.364545:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+55:11480:x1875415589265920:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 380us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535942.364560:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:1.0:1788535942.368253:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.368329:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589266048 00000100:00100000:2.0:1788535942.368338:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589266048 00000100:00100000:2.0:1788535942.368399:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1788535942.368410:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+55:2355:x1875415589266048:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535942.368439:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535942.368467:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d44ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158cf expref: 55 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.368487:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:2.0:1788535942.368492:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535942.368549:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+54:2355:x1875415589266048:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 141us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.368556:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788535942.370883:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535942.371129:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589266304 00000100:00100000:1.0:1788535942.371138:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589266304 00000100:00100000:1.0:1788535942.371190:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:1.0:1788535942.371200:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+54:11480:x1875415589266304:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788535942.371433:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+55:11480:x1875415589266304:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 233us (557us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788535942.371442:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1788535942.413985:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607089664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535942.414059:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535942.414141:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607089664 00000100:00100000:3.0:1788535942.414148:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607089664 00000100:00100000:3.0:1788535942.414189:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788535942.414197:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607089664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788535942.414248:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788535942.414289:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607089664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535942.414295:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788535942.414339:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607089664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535942.531174:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535942.531282:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589266560 00000100:00100000:0.0:1788535942.531292:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589266560 00000100:00100000:0.0:1788535942.531355:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:0.0:1788535942.531366:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+55:11498:x1875415589266560:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1788535942.531388:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535942.531409:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4502 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975158d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.531516:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4509 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.531533:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4509 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.531545:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4509 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535942.531556:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788535942.531677:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4502 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158d6 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.531695:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4509 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158d6 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.531704:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:0.0:1788535942.531718:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788535942.531722:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987eca800, rc 0) 00000100:00100000:0.0:1788535942.531783:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+57:11498:x1875415589266560:12345-192.168.203.12@tcp:101:cat.0 Request processed in 418us (617us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788535942.531791:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:2.0:1788535942.564471:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535942.564660:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589266688 00000100:00100000:0.0:1788535942.564671:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589266688 00000100:00100000:0.0:1788535942.564785:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:0.0:1788535942.564797:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+57:11499:x1875415589266688:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535942.564823:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535942.564849:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4517 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975158dd expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.564968:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d451e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.564983:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d451e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.564995:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d451e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535942.565032:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788535942.565036:0:6697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535942.565053:0:6697:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d451e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.565080:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4517 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158dd expref: 59 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.565115:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d451e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158dd expref: 58 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.565124:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:0.0:1788535942.565127:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788535942.565130:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecba00, rc 0) 00000100:00100000:0.0:1788535942.565194:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+58:11499:x1875415589266688:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 399us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.565201:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:3.0:1788535942.571364:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535942.571470:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589267072 00000100:00100000:1.0:1788535942.571479:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589267072 00000100:00100000:1.0:1788535942.571540:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:1.0:1788535942.571550:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+58:11499:x1875415589267072:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788535942.572183:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+59:11499:x1875415589267072:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 631us (824us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788535942.572191:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:1.0:1788535942.576713:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535942.576943:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589267200 00000100:00100000:0.0:1788535942.576953:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589267200 00000100:00100000:0.0:1788535942.577071:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1788535942.577083:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+59:11499:x1875415589267200:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:0.0:1788535942.577100:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788535942.577125:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d44ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158c1 expref: 59 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.577147:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4509 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158d6 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.577158:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d43b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515882 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.577168:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a9888adc00) 00010000:00010000:0.0:1788535942.577178:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535942.577254:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+56:11499:x1875415589267200:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 173us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.577263:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788535942.579662:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535942.580208:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589267328 00000100:00100000:3.0:1788535942.580218:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589267328 00000100:00100000:3.0:1788535942.580379:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:3.0:1788535942.580390:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+56:11499:x1875415589267328:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:3.0:1788535942.580504:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4525 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.580520:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4525 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.580597:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4525 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788535942.580806:0:11644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788535942.581131:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+56:11499:x1875415589267328:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 741us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535942.581140:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:3.0:1788535942.595050:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.595194:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589267456 00000100:00100000:2.0:1788535942.595204:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589267456 00000100:00100000:2.0:1788535942.595264:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:2.0:1788535942.595275:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+56:11501:x1875415589267456:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788535942.595296:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535942.595317:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d452c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975158e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595381:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4533 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595397:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595409:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595433:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d453a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595441:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d453a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595446:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d453a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595634:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4541 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595643:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595661:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535942.595689:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788535942.595692:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788535942.595705:0:5834:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595716:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595776:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595785:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4533 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595792:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4533 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595798:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535942.595803:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4533 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595811:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4533 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595822:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:2.0:1788535942.595825:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535942.595830:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4533 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595847:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4533 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595862:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d453a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595868:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d453a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595874:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d453a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595879:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535942.595882:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d453a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595980:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d453a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.595989:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a99742ab00) 00010000:00010000:2.0:1788535942.595992:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535942.595995:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d453a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.596000:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d453a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.596032:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d452c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158e4 expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.596045:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4541 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158e4 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.596059:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:2.0:1788535942.596062:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788535942.596065:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747ee00, rc 0) 00000100:00100000:2.0:1788535942.596167:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+57:11501:x1875415589267456:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 893us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.596175:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 170 00000040:00080000:2.0:1788535942.734469:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788535942.734477:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788535942.734517:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1788535942.734523:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788535942.734641:0:11640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf769500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11640:1875415607089792:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788535942.734744:0:11640:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9920060c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535942.738785:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535942.739177:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589267584 00000100:00100000:3.0:1788535942.739187:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589267584 00000100:00100000:3.0:1788535942.739248:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:3.0:1788535942.739258:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+58:11512:x1875415589267584:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788535942.739289:0:6697:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788535942.739389:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+58:11512:x1875415589267584:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 132us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535942.739396:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:2.0:1788535942.744631:0:11640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf769500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11640:1875415607089792:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788535942.747968:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.748498:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589267712 00000100:00100000:2.0:1788535942.748509:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589267712 00000100:00100000:2.0:1788535942.748570:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:2.0:1788535942.748580:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+57:11512:x1875415589267712:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788535942.748653:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4548 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748671:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4548 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748682:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4548 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748740:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d454f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748749:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d454f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748756:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d454f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748783:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4556 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748790:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748797:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535942.748834:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788535942.748838:0:11644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788535942.748850:0:11644:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748860:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4548 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748866:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4548 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748873:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4548 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748973:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ea00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535942.748978:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4548 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748986:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4548 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.748997:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a99742a400) 00010000:00010000:2.0:1788535942.748999:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535942.749004:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4548 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749009:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4548 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749021:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d454f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749027:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d454f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749032:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d454f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749037:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535942.749040:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d454f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749045:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d454f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749061:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff97a99742ab00) 00010000:00010000:2.0:1788535942.749063:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535942.749066:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d454f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749071:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d454f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749086:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749092:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4556 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749097:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4556 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749102:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535942.749104:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4556 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749109:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4556 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749115:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:2.0:1788535942.749117:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535942.749120:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4556 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.749125:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4556 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535942.749216:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+57:11512:x1875415589267712:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 636us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.749223:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:3.0:1788535942.751303:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.751541:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589267968 00000100:00100000:2.0:1788535942.751551:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589267968 00000100:00100000:2.0:1788535942.751596:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:2.0:1788535942.751606:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+57:11512:x1875415589267968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535942.751626:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535942.751645:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d455d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975158eb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.751824:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d4564 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.751838:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d4564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.751849:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d4564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535942.751862:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788535942.755643:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d4564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.755660:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d4564 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.755668:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d4564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.755674:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50c00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535942.755679:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d4564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.755687:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d4564 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.755780:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:3.0:1788535942.755783:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788535942.755789:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d4564 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.755795:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d4564 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.755849:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d455d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158eb expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.755860:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a99742a400) 00010000:00010000:3.0:1788535942.755863:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535942.755866:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d455d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158eb expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.755876:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747fe00, rc 0) 00000100:00100000:3.0:1788535942.756098:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+58:11512:x1875415589267968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 4492us (4802us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788535942.756107:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:0.0:1788535942.758782:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.758856:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589268096 00000100:00100000:2.0:1788535942.758865:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589268096 00000100:00100000:2.0:1788535942.758950:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:2.0:1788535942.758960:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+58:11512:x1875415589268096:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788535942.758994:0:5832:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788535942.759094:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+58:11512:x1875415589268096:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 134us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.759112:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:0.0:1788535942.768673:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535942.768758:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589268352 00000100:00100000:3.0:1788535942.768769:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589268352 00000100:00100000:3.0:1788535942.768826:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:3.0:1788535942.768837:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+58:11512:x1875415589268352:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535942.768857:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535942.768860:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788535942.768925:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d451e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158dd expref: 58 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.768953:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:3.0:1788535942.768959:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535942.768973:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d4572 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975158f2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788535942.769388:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788535942.769587:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4579 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.769601:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.769610:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.769659:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ac00/0x74f51638375d4572 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158f2 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.769673:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4579 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158f2 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.769680:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a997503a00) 00010000:00010000:3.0:1788535942.769683:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535942.769685:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b800, rc 0) 00000100:00100000:3.0:1788535942.769745:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+59:11512:x1875415589268352:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 910us (1082us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788535942.769752:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:0.0:1788535942.781324:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535942.788206:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589268608 00000100:00100000:1.0:1788535942.788221:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589268608 00000100:00100000:1.0:1788535942.788282:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:1.0:1788535942.788294:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+59:11512:x1875415589268608:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788535942.788370:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535942.788398:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4579 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158f2 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.788681:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a997503a00) 00010000:00010000:1.0:1788535942.788696:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535942.788721:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4587 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.788735:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4587 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.788744:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4587 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.788805:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d458e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe5382d9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.788813:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d458e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe5382d9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.788820:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d458e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe5382d9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789078:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4587 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789087:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4587 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789093:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4587 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789107:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0aa00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535942.789112:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4587 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789331:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4587 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789342:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:1.0:1788535942.789345:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535942.789349:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4587 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789355:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4587 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789366:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d458e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe5382d9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789373:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d458e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe5382d9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789379:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d458e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe5382d9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789384:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535942.789387:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d458e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe5382d9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789394:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d458e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe5382d9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789414:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe5382d9e (ffff97a9888ad900) 00010000:00010000:1.0:1788535942.789671:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535942.789676:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d458e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe5382d9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.789682:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d458e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe5382d9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535942.789777:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+58:11512:x1875415589268608:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1483us (8458us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788535942.789785:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:3.0:1788535942.792708:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.801470:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589268736 00000100:00100000:2.0:1788535942.801487:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589268736 00000100:00100000:2.0:1788535942.801768:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:2.0:1788535942.801780:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+58:11512:x1875415589268736:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535942.801801:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535942.801824:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50800/0x74f51638375d4595 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975158f9 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.801870:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51600/0x74f51638375d459c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.801884:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51600/0x74f51638375d459c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.802050:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51600/0x74f51638375d459c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.803054:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50800/0x74f51638375d4595 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158f9 expref: 60 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.803077:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51600/0x74f51638375d459c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158f9 expref: 59 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.803086:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a99742ab00) 00010000:00010000:2.0:1788535942.803088:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788535942.803091:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc51600, rc 0) 00000100:00100000:2.0:1788535942.803308:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+59:11512:x1875415589268736:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1529us (10607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.803332:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:1.0:1788535942.818537:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535942.818645:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589268992 00000100:00100000:0.0:1788535942.818656:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589268992 00000100:00100000:0.0:1788535942.818725:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:0.0:1788535942.818736:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+59:11512:x1875415589268992:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788535942.818850:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d45a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.818868:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d45a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535942.818881:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d45a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788535942.819361:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788535942.819371:0:6697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344950483416ns, next at 345950481116ns, rc = 0 00000004:00010000:0.0:1788535942.819469:0:6697:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000002cdc5b04 reply state 0000000085766d47 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d45a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535942.819480:0:6697:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788535942.819580:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+61:11512:x1875415589268992:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 846us (1063us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788535942.819588:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 178 00010000:00010000:2.0:1788535942.823181:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d45a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.823201:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d45a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.823208:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d45a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.823214:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535942.823219:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d45a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.823227:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d45a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.823246:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a99742ab00) 00010000:00010000:2.0:1788535942.823250:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788535942.823255:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d45a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.823261:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d45a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535942.830657:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535942.831120:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589269120 00000100:00100000:3.0:1788535942.831136:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589269120 00000100:00100000:3.0:1788535942.831196:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:3.0:1788535942.831207:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+60:11512:x1875415589269120:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535942.831232:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535942.831251:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d45aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515900 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.831315:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d45aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515900 expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.831329:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d45aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515900 expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.831346:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a99742ab00) 00010000:00010000:3.0:1788535942.831349:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788535942.831353:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b600, rc 0) 00000100:00100000:3.0:1788535942.831427:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+61:11512:x1875415589269120:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 212us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535942.831434:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:3.0:1788535942.834739:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535942.835498:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589269248 00000100:00100000:0.0:1788535942.835523:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589269248 00000100:00100000:0.0:1788535942.835597:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1788535942.835607:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+6:2355:x1875415589269248:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788535942.835971:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2355:x1875415589269248:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 364us (1240us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788535942.835979:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1788535942.857549:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535942.857686:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589269504 00000100:00100000:3.0:1788535942.857697:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589269504 00000100:00100000:3.0:1788535942.857762:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:3.0:1788535942.857772:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+61:11512:x1875415589269504:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788535942.858047:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+62:11512:x1875415589269504:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 275us (506us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788535942.858068:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1788535942.870466:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.870621:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589269760 00000100:00100000:2.0:1788535942.870630:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589269760 00000100:00100000:2.0:1788535942.870696:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:2.0:1788535942.870706:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+62:11512:x1875415589269760:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788535942.870849:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+62:11512:x1875415589269760:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 136us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.870871:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:3.0:1788535942.873600:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535942.873702:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589269888 00000100:00100000:1.0:1788535942.873712:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589269888 00000100:00100000:1.0:1788535942.873770:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:1.0:1788535942.873781:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+62:11512:x1875415589269888:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788535942.873802:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535942.873824:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d45b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515907 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.873944:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d45b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.873959:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d45b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.873992:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d45b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535942.874032:0:6697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788535942.874052:0:6697:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d45b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.874080:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d45b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515907 expref: 64 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.874096:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d45b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515907 expref: 63 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535942.874105:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a99742ab00) 00010000:00010000:1.0:1788535942.874108:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788535942.874111:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0bc00, rc 0) 00000100:00100000:1.0:1788535942.874163:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+63:11512:x1875415589269888:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 384us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535942.874170:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:0.0:1788535942.897315:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.897413:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589270016 00000100:00100000:2.0:1788535942.897432:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589270016 00000100:00100000:2.0:1788535942.897494:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1788535942.897512:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+7:2356:x1875415589270016:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535942.897528:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535942.897548:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e0857b1/0x74f51638375d45bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751590e expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788535942.897585:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ae486, blocks: 0x1 00010000:00010000:2.0:1788535942.897603:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788535942.897607:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535942.898093:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e0857b1/0x74f51638375d45bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751590e expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.898116:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e0857b1/0x74f51638375d45bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751590e expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.898131:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc50800, rc 0) 00000100:00100000:2.0:1788535942.898192:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+8:2356:x1875415589270016:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 689us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.898199:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1788535942.917760:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535942.918336:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589270272 00000100:00100000:3.0:1788535942.918348:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589270272 00000100:00100000:3.0:1788535942.918463:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:3.0:1788535942.918475:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+63:11512:x1875415589270272:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788535942.918602:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+63:11512:x1875415589270272:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 129us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535942.918611:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:0.0:1788535942.932081:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535942.934084:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589270400 00000100:00100000:3.0:1788535942.934096:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589270400 00000100:00100000:3.0:1788535942.934187:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788535942.934199:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:11512:x1875415589270400:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535942.934215:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535942.934235:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d45c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515915 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.934265:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e0857b1/0x74f51638375d45bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751590e expref: 9 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.934275:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535942.934279:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535942.934285:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d45c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515915 expref: 9 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.934347:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e0857b1/0x74f51638375d45bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751590e expref: 9 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.934361:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e0857b1/0x74f51638375d45bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751590e expref: 9 pid: 8424 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535942.934375:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf2a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1875415607089920:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535942.934477:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535942.941811:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.943108:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589270528 00000100:00100000:2.0:1788535942.943122:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589270528 00010000:00010000:2.0:1788535942.943167:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e0857b1/0x74f51638375d45bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751590e expref: 10 pid: 8424 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535942.943235:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:2.0:1788535942.943245:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+10:2355:x1875415589270528:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535942.943259:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535942.943280:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e0857b1/0x74f51638375d45bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751590e expref: 10 pid: 8424 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.943305:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e0857b1/0x74f51638375d45bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751590e expref: 10 pid: 8424 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.943331:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535942.943335:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535942.943343:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d45c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515915 expref: 10 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.943353:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d45c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515915 expref: 10 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535942.943391:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d45c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515915 expref: 10 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535942.943405:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf769500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875415607090048:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788535942.943495:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a992006b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788535942.946389:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e0857b1/0x74f51638375d45bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751590e expref: 10 pid: 8424 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535942.946425:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf2a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1875415607089920:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788535942.946458:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d45c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515915 expref: 9 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535942.946473:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4ac00, rc 0) 00000100:00100000:0.0:1788535942.954483:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+9:11512:x1875415589270400:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 20275us (22400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.954496:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:1.0:1788535942.980674:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf769500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875415607090048:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788535942.980703:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535942.980768:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535942.980797:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589270528:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 37551us (38994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.980812:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1788535942.980871:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589270656 00000100:00100000:3.0:1788535942.980880:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589270656 00002000:00100000:3.0:1788535942.980941:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97a986f14380 x1875415589270656/t0(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:598/0 lens 504/0 e 0 to 0 dl 1788535953 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788535942.980998:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a986f14380 with x1875415589270656 ext(0->8) 00002000:00010000:3.0:1788535942.981004:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a986f14380 00000100:00100000:3.0:1788535942.981033:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788535942.981050:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:30a1922d-0d3f-4681-a966-cec3672631c6+8:2356:x1875415589270656:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788535942.981477:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:30a1922d-0d3f-4681-a966-cec3672631c6+10:2356:x1875415589270656:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 427us (708us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788535942.981485:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00002000:00100000:3.0:1788535942.981492:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97a986f14380 x1875415589270656/t4294967314(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:598/0 lens 504/448 e 0 to 0 dl 1788535953 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788535942.981511:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a986f14380 with x1875415589270656 ext(0->8) 00002000:00010000:3.0:1788535942.981515:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a986f14380 00000100:00100000:0.0:1788535942.993697:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535942.993751:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589270784 00000100:00100000:1.0:1788535942.993760:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589270784 00000100:00100000:1.0:1788535942.993821:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:1.0:1788535942.993831:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+63:11512:x1875415589270784:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1788535943.065266:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535943.096684:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+63:11512:x1875415589270784:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 102842us (102985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535943.096697:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 183 00000001:00080000:2.0:1788535943.096780:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1788535943.096787:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:2.0:1788535943.097002:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1788535943.097025:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788535943.097040:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a9b67fe480 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788535943.097044:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9bf710000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a9b67fe000 00000020:00080000:2.0:1788535943.097047:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9bf710600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a9b705a400 00000020:00080000:2.0:1788535943.097168:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788535943.097345:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788535943.097363:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607090176:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788535943.097429:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535943.097501:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607090176 00000100:00100000:2.0:1788535943.097508:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607090176 00000100:00100000:2.0:1788535943.097557:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788535943.097566:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875415607090176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788535943.097589:0:6671:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1788535943.097620:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ae484, atime: 0x6a9ae484, ctime: 0x6a9ae484, blocks: 0x1 00010000:00010000:2.0:1788535943.097629:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d45cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.097645:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788535943.097649:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535943.097656:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d45cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.097692:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d45cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.097704:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d45cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.097712:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d45cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.097730:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788535943.098500:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607090304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788535943.098544:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535943.098677:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607090304 00000100:00100000:1.0:1788535943.098683:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607090304 00000100:00100000:1.0:1788535943.098728:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788535943.098737:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607090304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788535943.098878:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788535943.098966:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788535943 00002000:00010000:1.0:1788535943.098969:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788535943.098971:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788535942 -> 1788535943 00002000:00010000:1.0:1788535943.098974:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788535943.099016:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875415607090304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 280us (470us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788535943.099023:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1788535943.099065:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a9c0b3f800/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788535943.099071:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607090304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788535943.100112:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535943.100908:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1875415607090176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3317us (3452us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788535943.100918:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788535943.100941:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589270912 00000100:00100000:2.0:1788535943.100949:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589270912 00000100:00100000:2.0:1788535943.100980:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:2.0:1788535943.100987:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+10:2356:x1875415589270912:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1788535943.101041:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535943.101045:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788535943.101058:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535943.101066:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d45cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.101078:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:2.0:1788535943.101083:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d45cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.101102:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d45cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.101122:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d45cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.101130:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d45cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.101149:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535943.101151:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535943.101153:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788535943.101183:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a9bf768a80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788535943.101189:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607090176:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788535943.146816:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1788535943.146833:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1788535943.146838:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1788535943.147130:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+7:2356:x1875415589270912:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 46136us (47015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535943.147140:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:3.0:1788535943.154481:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535943.155372:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589271168 00000100:00100000:1.0:1788535943.155384:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589271168 00000100:00100000:1.0:1788535943.155451:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:1.0:1788535943.155461:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+18:11512:x1875415589271168:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788535943.155510:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535943.155595:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d45b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515907 expref: 18 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.155614:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a99742ab00) 00010000:00010000:1.0:1788535943.155619:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535943.155648:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d45d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.155661:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d45d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.155670:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d45d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788535943.156429:0:5833:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000780dddce reply state 0000000005d2f2d4 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d45d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535943.156441:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535943.156640:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+19:11512:x1875415589271168:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1178us (2165us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788535943.156647:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:0.0:1788535943.160559:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535943.160915:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589271296 00000100:00100000:2.0:1788535943.160925:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589271296 00000100:00100000:2.0:1788535943.160984:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1788535943.160993:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+7:2358:x1875415589271296:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788535943.161389:0:8424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788535943.161394:0:8424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788535943 -> 1788535942 00002000:00010000:2.0:1788535943.161397:0:8424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788535940 00002000:00010000:2.0:1788535943.161399:0:8424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788535943 -> 1788535942 00002000:00010000:2.0:1788535943.161401:0:8424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788535943.161476:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+8:2358:x1875415589271296:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 483us (925us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788535943.161500:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00010000:00010000:1.0:1788535943.161581:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d45d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.161591:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d45d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.161597:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d45d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.161603:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ba00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535943.161608:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d45d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.161623:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d45d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.161641:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a99742ab00) 00010000:00010000:1.0:1788535943.161644:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535943.161650:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d45d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.161657:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d45d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535943.163750:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535943.164197:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589271552 00000100:00100000:3.0:1788535943.164207:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589271552 00000100:00100000:3.0:1788535943.164314:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:3.0:1788535943.164324:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+18:11512:x1875415589271552:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788535943.164391:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.164407:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51600/0x74f51638375d459c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158f9 expref: 18 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.164446:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.164482:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51600/0x74f51638375d459c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158f9 expref: 18 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.164496:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51600/0x74f51638375d459c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158f9 expref: 18 pid: 11644 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535943.164508:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b26a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607090432:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535943.164597:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98626bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535943.166879:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b26a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607090432:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535943.166956:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535943.169559:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535943.170301:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589271680 00000100:00100000:3.0:1788535943.170311:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589271680 00010000:00010000:3.0:1788535943.170354:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51600/0x74f51638375d459c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158f9 expref: 19 pid: 11644 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535943.170398:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:3.0:1788535943.170407:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+19:2355:x1875415589271680:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535943.170430:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535943.170438:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51600/0x74f51638375d459c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158f9 expref: 19 pid: 11644 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.170452:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51600/0x74f51638375d459c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158f9 expref: 19 pid: 11644 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.170473:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51600/0x74f51638375d459c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158f9 expref: 19 pid: 11644 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.170503:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a99742ab00) 00010000:00010000:3.0:1788535943.170508:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.170518:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.170526:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.170557:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535943.170605:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+18:2355:x1875415589271680:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 198us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535943.170612:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00010000:00010000:2.0:1788535943.171022:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.171032:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.171064:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.171080:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.171086:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.171091:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.171096:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.171103:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.171114:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a99742ab00) 00010000:00010000:2.0:1788535943.171116:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788535943.171120:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.171126:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a600/0x74f51638375d45db lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535943.171184:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+17:11512:x1875415589271552:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 6861us (7446us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788535943.171192:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:2.0:1788535943.175827:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535943.175927:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589271808 00000100:00100000:3.0:1788535943.175936:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589271808 00000100:00100000:3.0:1788535943.175982:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:3.0:1788535943.175991:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:2357:x1875415589271808:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788535943.176030:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.176050:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d45c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515915 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.176058:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535943.176063:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535943.176067:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.176291:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d45c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515915 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.176305:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d45c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515915 expref: 8 pid: 6673 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535943.176319:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b26a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1875415607090560:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535943.176399:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98626b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788535943.182511:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535943.182546:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589271936 00000100:00100000:3.0:1788535943.182554:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589271936 00010000:00010000:3.0:1788535943.182589:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d45c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515915 expref: 9 pid: 6673 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535943.182626:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1788535943.182634:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+9:2356:x1875415589271936:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535943.182649:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535943.182672:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d45c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515915 expref: 9 pid: 6673 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.182686:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d45c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515915 expref: 9 pid: 6673 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.182721:0:7598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535943.182734:0:7598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535943.182741:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.182750:0:7598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.182770:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535943.182816:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+9:2356:x1875415589271936:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 181us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535943.182824:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00010000:00010000:3.0:1788535943.182870:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d45c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515915 expref: 8 pid: 6673 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535943.182927:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b26a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1875415607090560:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788535943.182948:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.182959:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.182966:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.182989:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.183008:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.183016:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.183023:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b800 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788535943.183027:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.183037:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.183048:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.183056:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d45e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535943.183099:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2357:x1875415589271808:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 7109us (7279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535943.183107:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788535943.189453:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535943.189538:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589272192 00000100:00100000:3.0:1788535943.189548:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589272192 00000100:00100000:3.0:1788535943.189610:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:3.0:1788535943.189633:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+17:11512:x1875415589272192:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788535943.189715:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d45e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.189734:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d45e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.189746:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d45e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.190096:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.190108:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d45aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515900 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.190117:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.190255:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d45aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515900 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.190272:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d45aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515900 expref: 18 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535943.190287:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf135f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875415607090688:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535943.190410:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98626b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788535943.194365:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535943.194398:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589272320 00000100:00100000:3.0:1788535943.194431:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589272320 00010000:00010000:3.0:1788535943.194469:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d45aa lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515900 expref: 19 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535943.194510:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1788535943.194520:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+19:2356:x1875415589272320:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535943.194534:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535943.194541:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d45aa lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515900 expref: 19 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.194554:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d45aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515900 expref: 19 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.194576:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a99742ab00) 00010000:00010000:3.0:1788535943.194581:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.194590:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.194597:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.194617:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535943.194662:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+19:2356:x1875415589272320:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 143us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535943.194669:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00010000:00010000:1.0:1788535943.194834:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d45aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515900 expref: 18 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535943.194851:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf135f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875415607090688:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535943.194870:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.194879:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.194978:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788535943.195541:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788535943.195687:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788535943.207451:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788535943.207560:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875415607090816:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788535943.207668:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535943.207751:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9924cbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788535943.210806:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607090816 00000100:00100000:2.0:1788535943.210823:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607090816 00000100:00100000:3.0:1788535943.212604:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788535943.212617:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1875415607090816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788535943.212873:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1875415607090816:12345-0@lo:1000:mdt00_000.0 Request processed in 258us (5204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535943.212881:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788535943.220054:0:5832:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788535943.220065:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a9c0b3f800, transno 4294967315 00000100:00100000:1.0:1788535943.220084:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875415607090816:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788535943.230239:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788535943.230332:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b735c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875415607090944:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788535943.230397:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535943.230433:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99114a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535943.235633:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607090944 00000100:00100000:1.0:1788535943.235648:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607090944 00000100:00100000:1.0:1788535943.235731:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788535943.235742:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1875415607090944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788535943.236386:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1875415607090944:12345-0@lo:1000:mdt00_000.0 Request processed in 644us (5986us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788535943.236395:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788535943.236598:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b735c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875415607090944:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788535943.236644:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236655:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236663:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236680:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980031000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535943.236684:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236702:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236717:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a99742ab00) 00010000:00010000:0.0:1788535943.236720:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788535943.236725:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236732:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d45f0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236763:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4525 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236769:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4525 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236774:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4525 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236779:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4bc00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535943.236782:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4525 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236788:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4525 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236805:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:0.0:1788535943.236808:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788535943.236811:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4525 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236817:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4bc00/0x74f51638375d4525 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236840:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236853:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4541 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158e4 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.236862:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.237125:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4541 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158e4 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.237263:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4541 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158e4 expref: 21 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535943.237278:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875415607091072:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535943.237365:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99114a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535943.250495:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535943.250582:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589272448 00000100:00100000:1.0:1788535943.250591:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589272448 00010000:00010000:1.0:1788535943.250632:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4541 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158e4 expref: 22 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535943.250670:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:1.0:1788535943.250680:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+22:2356:x1875415589272448:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535943.250705:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535943.250713:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4541 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158e4 expref: 22 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.250748:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4541 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158e4 expref: 22 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.250771:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:1.0:1788535943.250777:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.250787:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.250794:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.250815:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535943.250867:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+22:2356:x1875415589272448:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 188us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535943.250876:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00010000:00010000:0.0:1788535943.251441:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4541 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975158e4 expref: 21 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535943.251461:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875415607091072:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535943.251491:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251501:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251506:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251519:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251525:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251532:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251538:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535943.251543:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251550:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251561:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:0.0:1788535943.251564:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535943.251568:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251574:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251594:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d45e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251600:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d45e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251607:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d45e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251613:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535943.251616:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d45e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251622:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d45e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251630:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a997503300) 00010000:00010000:0.0:1788535943.251633:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788535943.251636:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d45e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.251643:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d45e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535943.252054:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+20:11512:x1875415589272192:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 62421us (62608us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788535943.252064:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 186 00000020:00080000:0.0:1788535943.252068:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788535943.252542:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788535943.252548:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788535943.257514:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788535943.257533:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788535943.267848:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535943.268044:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589272704 00000100:00100000:0.0:1788535943.268053:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589272704 00000100:00100000:0.0:1788535943.268123:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1788535943.268133:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99c789050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+20:11512:x1875415589272704:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788535943.268803:0:5836:0:(mdd_object.c:4338:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788535943.268947:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788535943.268991:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.269007:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.269019:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.269028:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45fe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.269035:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45fe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.269042:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.269059:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788535943.269146:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99c789050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+22:11512:x1875415589272704:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 1012us (1303us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788535943.269154:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000020:00080000:0.0:1788535943.269159:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788535943.270136:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535943.270147:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.270157:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca600 already unused, calling callback (ffffffffc1455530) 00010000:00010000:2.0:1788535943.270161:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.270169:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.270184:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:2.0:1788535943.270187:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788535943.270192:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45fe lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.270197:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca600/0x74f51638375d45fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.270217:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535943.270219:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535943.270221:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788535943.346181:0:12412:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535943.346191:0:12412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788535943.346235:0:12412:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788535943.346240:0:12412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788535943.438007:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607091200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535943.438073:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535943.438228:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607091200 00000100:00100000:0.0:1788535943.438236:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607091200 00000100:00100000:0.0:1788535943.438285:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788535943.438294:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875415607091200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788535943.438337:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535943.438376:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875415607091200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535943.438383:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788535943.438471:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607091200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535943.480571:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535943.480659:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589272960 00000100:00100000:1.0:1788535943.480669:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589272960 00000100:00100000:1.0:1788535943.480727:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:1.0:1788535943.480813:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+22:11522:x1875415589272960:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788535943.480836:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535943.480854:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d4605 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751591c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.480963:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d460c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.480989:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d460c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.481000:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d460c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535943.481010:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788535943.481226:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a800/0x74f51638375d4605 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751591c expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.481243:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d460c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751591c expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.481251:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:1.0:1788535943.481255:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788535943.481258:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a400, rc 0) 00000100:00100000:1.0:1788535943.481320:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+24:11522:x1875415589272960:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 510us (757us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788535943.481326:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:1.0:1788535943.487647:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535943.487733:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589273088 00000100:00100000:2.0:1788535943.487752:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589273088 00000100:00100000:2.0:1788535943.487807:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:2.0:1788535943.487818:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+24:11522:x1875415589273088:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1788535943.487900:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d461a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.487916:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d461a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.487927:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d461a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.487985:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4621 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.487992:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.487999:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488216:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51e00/0x74f51638375d4628 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488225:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51e00/0x74f51638375d4628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488232:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51e00/0x74f51638375d4628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535943.488269:0:5834:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51e00/0x74f51638375d4628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488293:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d461a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488298:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d461a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488305:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d461a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488311:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.488315:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d461a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488322:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d461a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488333:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:2.0:1788535943.488336:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535943.488340:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d461a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488346:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d461a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488356:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488362:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4621 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488368:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488379:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.488382:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488388:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4621 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488396:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a99742ad00) 00010000:00010000:2.0:1788535943.488399:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535943.488401:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4621 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488407:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4621 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488435:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51e00/0x74f51638375d4628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488440:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51e00/0x74f51638375d4628 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488445:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51e00/0x74f51638375d4628 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488450:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51e00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.488452:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51e00/0x74f51638375d4628 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488459:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51e00/0x74f51638375d4628 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488475:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742ae00) 00010000:00010000:2.0:1788535943.488478:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535943.488481:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51e00/0x74f51638375d4628 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.488487:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51e00/0x74f51638375d4628 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535943.488561:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+24:11522:x1875415589273088:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 744us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535943.488570:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:3.0:1788535943.526229:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535943.527644:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589273344 00000100:00100000:2.0:1788535943.527656:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589273344 00000100:00100000:2.0:1788535943.527726:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:2.0:1788535943.527737:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+24:11525:x1875415589273344:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788535943.527757:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535943.527779:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51e00/0x74f51638375d462f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515923 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.527851:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4636 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.527866:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4636 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.527878:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4636 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.527913:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d463d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.527930:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d463d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.527937:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d463d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528186:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4644 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528195:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4644 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528202:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4644 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535943.528212:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788535943.528298:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4636 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528305:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4636 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528311:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4636 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528317:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.528321:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4636 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528328:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4636 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528349:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:2.0:1788535943.528352:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535943.528357:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4636 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528363:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4636 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528375:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d463d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528381:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d463d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528386:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d463d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528391:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.528394:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d463d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528400:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d463d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528407:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a99742ae00) 00010000:00010000:2.0:1788535943.528409:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535943.528425:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d463d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528431:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51400/0x74f51638375d463d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528483:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51e00/0x74f51638375d462f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515923 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528509:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4644 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515923 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.528517:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:2.0:1788535943.528519:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535943.528521:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc50a00, rc 0) 00000100:00100000:2.0:1788535943.528595:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+26:11525:x1875415589273344:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 859us (2374us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788535943.528603:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:2.0:1788535943.531727:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535943.531803:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589273472 00000100:00100000:3.0:1788535943.531814:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589273472 00000100:00100000:3.0:1788535943.531870:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:3.0:1788535943.531880:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+26:11525:x1875415589273472:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1788535943.531971:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4652 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.531988:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.532001:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.532026:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.532033:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4652 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.532040:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4652 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.532058:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980031e00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535943.532062:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4652 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.532070:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4652 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.532082:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:3.0:1788535943.532085:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535943.532090:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4652 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.532096:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4652 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535943.532166:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+26:11525:x1875415589273472:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 286us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535943.532174:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:3.0:1788535943.548603:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535943.558462:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589273728 00000100:00100000:0.0:1788535943.558478:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589273728 00000100:00100000:0.0:1788535943.558545:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1788535943.558555:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+26:11525:x1875415589273728:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788535943.558874:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+27:11525:x1875415589273728:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 318us (10280us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788535943.559802:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1788535943.604842:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535943.605318:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589273984 00000100:00100000:1.0:1788535943.605342:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589273984 00000100:00100000:1.0:1788535943.605439:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:1.0:1788535943.605449:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+27:11059:x1875415589273984:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788535943.605472:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535943.605492:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4659 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751592a expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.605595:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.605609:0:11644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4644 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515923 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.605619:0:11644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.605651:0:11644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4644 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515923 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.605664:0:11644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4644 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515923 expref: 28 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535943.605677:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607091328:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788535943.605862:0:11644:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9924cbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788535943.609463:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535943.609558:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607091328:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535943.609585:0:11644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535943.610141:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589274112 00000100:00100000:3.0:1788535943.610152:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589274112 00010000:00010000:3.0:1788535943.610189:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4644 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515923 expref: 29 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535943.610232:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:3.0:1788535943.610242:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+29:2356:x1875415589274112:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535943.610255:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535943.610273:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4644 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515923 expref: 29 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.610285:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4644 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515923 expref: 29 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.610309:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4644 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515923 expref: 29 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.610324:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:3.0:1788535943.610328:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.610338:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.610346:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.610428:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535943.610489:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+28:2356:x1875415589274112:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 247us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535943.610497:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00010000:00010000:1.0:1788535943.610537:0:11644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.610550:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535943.610570:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788535943.612265:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ac00/0x74f51638375d4659 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751592a expref: 29 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.612291:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751592a expref: 28 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.612299:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:1.0:1788535943.612303:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788535943.612306:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0be00, rc 0) 00000100:00100000:1.0:1788535943.612425:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+28:11059:x1875415589273984:12345-192.168.203.12@tcp:101:bash.0 Request processed in 6975us (7592us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788535943.612433:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:3.0:1788535943.615517:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535943.615602:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589274368 00000100:00100000:2.0:1788535943.615611:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589274368 00000100:00100000:2.0:1788535943.615687:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:2.0:1788535943.615703:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+28:11059:x1875415589274368:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:2.0:1788535943.616263:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d466e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.616280:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d466e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.616291:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d466e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535943.616363:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788535943.616387:0:5832:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000ef3210d9 reply state 000000000cd4706b transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d466e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535943.616396:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788535943.616461:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788535943.616563:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+32:11059:x1875415589274368:12345-192.168.203.12@tcp:36:bash.0 Request processed in 859us (1055us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788535943.616570:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 192 00000020:00080000:2.0:1788535943.616576:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788535943.618587:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:2.0:1788535943.618998:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d466e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.619010:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d466e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.619017:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d466e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.619022:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.619026:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d466e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.619033:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d466e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.619050:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:2.0:1788535943.619052:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535943.619057:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d466e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.619077:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d466e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535943.619177:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589274496 00000100:00100000:1.0:1788535943.619187:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589274496 00000100:00100000:1.0:1788535943.619269:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:1.0:1788535943.619279:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+31:11059:x1875415589274496:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788535943.619300:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535943.619318:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4675 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515931 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.619373:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4675 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515931 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.619398:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4675 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515931 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.619428:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:1.0:1788535943.619431:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788535943.619434:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0aa00, rc 0) 00000100:00100000:1.0:1788535943.619484:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+32:11059:x1875415589274496:12345-192.168.203.12@tcp:101:bash.0 Request processed in 207us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535943.619491:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:2.0:1788535943.626698:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535943.626791:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589274624 00000100:00100000:0.0:1788535943.626801:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589274624 00000100:00100000:0.0:1788535943.626859:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:0.0:1788535943.626875:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+7:11059:x1875415589274624:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788535943.626926:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535943.626949:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d467c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515938 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535943.626975:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ae486, atime: 0x6a9ae484, ctime: 0x6a9ae486, blocks: 0xb 00010000:00010000:0.0:1788535943.626996:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788535943.627000:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535943.627010:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d467c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515938 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.627053:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d467c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515938 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.627070:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987eca600, rc 0) 00000100:00100000:0.0:1788535943.627125:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+8:11059:x1875415589274624:12345-192.168.203.12@tcp:101:bash.0 Request processed in 252us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535943.627131:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:1.0:1788535943.633544:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535943.633640:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589274752 00000100:00100000:0.0:1788535943.633651:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589274752 00002000:00010000:0.0:1788535943.633762:0:6679:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1788535943.633768:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9c0b3ea00 with x1875415589274752 ext(0->18446744073709551615) 00002000:00010000:0.0:1788535943.633781:0:6679:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a9c0b3ea00. 00000100:00100000:0.0:1788535943.633847:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1788535943.633857:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:30a1922d-0d3f-4681-a966-cec3672631c6+8:2356:x1875415589274752:12345-192.168.203.12@tcp:10:bash.0 00002000:00010000:0.0:1788535943.634136:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788535943.634141:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788535942 -> 1788535943 00002000:00010000:0.0:1788535943.634144:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788535940 -> 1788535940 00002000:00010000:0.0:1788535943.634146:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788535942 -> 1788535943 00002000:00010000:0.0:1788535943.634149:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788535943.634213:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:30a1922d-0d3f-4681-a966-cec3672631c6+9:2356:x1875415589274752:12345-192.168.203.12@tcp:10:bash.0 Request processed in 357us (678us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788535943.634221:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00002000:00010000:0.0:1788535943.634225:0:6679:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1788535943.634227:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9c0b3ea00 with x1875415589274752 ext(0->18446744073709551615) 00002000:00010000:0.0:1788535943.634244:0:6679:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a9c0b3ea00. 00000100:00100000:1.0:1788535943.706796:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535943.706930:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589274880 00000100:00100000:0.0:1788535943.706940:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589274880 00000100:00100000:0.0:1788535943.707002:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:0.0:1788535943.707012:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+32:11539:x1875415589274880:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788535943.707090:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4683 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707108:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4683 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707121:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4683 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707138:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d468a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707145:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d468a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707151:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d468a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707387:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4691 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707397:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707405:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535943.707469:0:11644:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707482:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4683 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707488:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4683 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707496:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4683 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707502:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535943.707506:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4683 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707514:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4683 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707526:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:0.0:1788535943.707529:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535943.707534:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4683 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707540:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4683 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707552:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d468a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707558:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d468a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707571:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d468a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707575:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecbe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535943.707578:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d468a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707584:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d468a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707593:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a9a0685300) 00010000:00010000:0.0:1788535943.707595:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535943.707598:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d468a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707604:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d468a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707618:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707624:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4691 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707630:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4691 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707635:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535943.707638:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4691 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707652:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4691 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707661:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:0.0:1788535943.707664:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535943.707667:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4691 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.707672:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d4691 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535943.707740:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+32:11539:x1875415589274880:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 728us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535943.707749:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:3.0:1788535943.742645:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535943.742953:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589275136 00000100:00100000:2.0:1788535943.742965:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589275136 00000100:00100000:2.0:1788535943.743039:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:2.0:1788535943.743050:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+32:11542:x1875415589275136:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788535943.743071:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535943.743094:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4698 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751593f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743204:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d469f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743223:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d469f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743236:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d469f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743251:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743259:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743265:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743556:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d46ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743567:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d46ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743575:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d46ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535943.743586:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788535943.743700:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d469f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743709:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d469f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743716:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d469f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743722:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.743735:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d469f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743743:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d469f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743755:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:2.0:1788535943.743758:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535943.743763:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d469f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743780:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d469f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743792:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743797:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743803:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743808:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.743812:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743818:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743826:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a99742ae00) 00010000:00010000:2.0:1788535943.743829:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535943.743832:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743838:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743880:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d4698 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751593f expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743951:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d46ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751593f expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.743964:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:2.0:1788535943.743967:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788535943.743970:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc51800, rc 0) 00000100:00100000:2.0:1788535943.744049:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+34:11542:x1875415589275136:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1000us (1415us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788535943.744057:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:1.0:1788535943.746962:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535943.747052:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589275264 00000100:00100000:2.0:1788535943.747063:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589275264 00000100:00100000:2.0:1788535943.747119:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:2.0:1788535943.747130:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+34:11542:x1875415589275264:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1788535943.747198:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.747215:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751592a expref: 34 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.747225:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.747260:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751592a expref: 34 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.747273:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751592a expref: 34 pid: 11644 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535943.747288:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf768700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607091456:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788535943.747399:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a992006b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535943.752633:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535943.752791:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf768700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607091456:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535943.752819:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535943.752931:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589275520 00000100:00100000:1.0:1788535943.752940:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589275520 00000100:00100000:1.0:1788535943.752996:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:1.0:1788535943.753005:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+35:5593:x1875415589275520:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788535943.753319:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+36:5593:x1875415589275520:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 314us (694us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788535943.753326:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788535943.758536:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535943.759836:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589275648 00000100:00100000:1.0:1788535943.759849:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589275648 00010000:00010000:1.0:1788535943.759929:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751592a expref: 36 pid: 11644 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535943.759974:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:1.0:1788535943.759984:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9230a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+36:2356:x1875415589275648:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535943.760010:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535943.760018:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751592a expref: 36 pid: 11644 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.760046:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751592a expref: 36 pid: 11644 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.760069:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4660 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751592a expref: 36 pid: 11644 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.760085:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:1.0:1788535943.760090:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.760100:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.760108:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.760144:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535943.760206:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9230a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+35:2356:x1875415589275648:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 223us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535943.760214:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00010000:00010000:2.0:1788535943.760464:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.760476:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.760510:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.760517:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.760524:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.760531:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.760535:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.760543:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.760553:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:2.0:1788535943.760556:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788535943.760560:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.760577:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535943.760622:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+34:11542:x1875415589275264:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 13493us (13670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535943.760630:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:3.0:1788535943.762714:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535943.762981:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589275904 00000100:00100000:2.0:1788535943.762990:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589275904 00000100:00100000:2.0:1788535943.763038:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:2.0:1788535943.763048:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+34:11542:x1875415589275904:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788535943.763286:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+35:11542:x1875415589275904:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 238us (579us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788535943.763294:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788535943.846228:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535943.846350:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589276160 00000100:00100000:3.0:1788535943.846361:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589276160 00000100:00100000:3.0:1788535943.846435:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:3.0:1788535943.846462:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+35:11553:x1875415589276160:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:3.0:1788535943.846489:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535943.846512:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d46c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515946 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.846589:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d46c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.846604:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d46c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.846616:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d46c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.846631:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d46d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.846639:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d46d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.846646:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d46d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.846959:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d46d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.846970:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d46d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.846978:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d46d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535943.847246:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788535943.847339:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d46c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847347:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d46c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847354:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d46c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847370:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980030600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535943.847374:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d46c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847382:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d46c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847394:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:3.0:1788535943.847397:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535943.847402:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d46c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847416:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d46c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847429:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d46d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847436:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d46d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847452:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d46d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847458:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980031c00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535943.847461:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d46d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847468:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d46d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847477:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a997503c00) 00010000:00010000:3.0:1788535943.847480:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535943.847483:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d46d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847490:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d46d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847536:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d46c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515946 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847550:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d46d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515946 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.847558:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:3.0:1788535943.847560:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535943.847563:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980031000, rc 0) 00000100:00100000:3.0:1788535943.847631:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+37:11553:x1875415589276160:12345-192.168.203.12@tcp:101:cat.0 Request processed in 1171us (1416us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788535943.847648:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:3.0:1788535943.854717:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535943.856342:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589276416 00000100:00100000:2.0:1788535943.856355:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589276416 00000100:00100000:2.0:1788535943.856427:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:2.0:1788535943.856438:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+37:11553:x1875415589276416:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:2.0:1788535943.857174:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+38:11553:x1875415589276416:12345-192.168.203.12@tcp:35:cat.0 Request processed in 735us (2463us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788535943.857183:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1788535943.885703:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535943.885880:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589276672 00000100:00100000:2.0:1788535943.886031:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589276672 00000100:00100000:2.0:1788535943.886133:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:2.0:1788535943.886144:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+38:11554:x1875415589276672:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1788535943.886201:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788535943.886241:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d46d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515946 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.886265:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d46ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751593f expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.886277:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4675 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515931 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.886287:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742ad00) 00010000:00010000:2.0:1788535943.886296:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535943.886315:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.886328:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.886336:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.886347:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d46ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.886353:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d46ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.886359:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d46ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.886599:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.886617:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.886624:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788535943.887293:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788535943.887304:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346018415615ns, next at 347018413530ns, rc = 0 00010000:00010000:2.0:1788535943.887362:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d46fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887372:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d46fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887380:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d46fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887387:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d46fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887393:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d46fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887399:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d46fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887431:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788535943.887450:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887457:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887470:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887476:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.887480:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887488:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887498:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742aa00) 00010000:00010000:2.0:1788535943.887501:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788535943.887505:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887512:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d46f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887528:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887535:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887540:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887545:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.887547:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887562:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887571:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:2.0:1788535943.887574:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535943.887577:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.887583:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d46e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535943.887593:0:5832:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000b11cafb1 reply state 00000000c2cfb2cc transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d46ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535943.887601:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788535943.887683:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+37:11554:x1875415589276672:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1539us (1989us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788535943.887692:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 198 00010000:00010000:1.0:1788535943.887909:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535943.887916:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d46fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.887924:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51200 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788535943.887934:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d46fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.887941:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d46fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.887952:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97a99742aa00) 00010000:00010000:1.0:1788535943.887954:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788535943.887958:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d46fa lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.887964:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d46fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.887977:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535943.887979:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535943.887981:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535943.890465:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d46ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.890483:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d46ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.890491:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d46ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.890508:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535943.890513:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d46ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.890521:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d46ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.890539:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a99742ae00) 00010000:00010000:3.0:1788535943.890542:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535943.890547:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d46ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.890554:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50200/0x74f51638375d46ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535943.923716:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535943.924160:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589276928 00000100:00100000:2.0:1788535943.924170:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589276928 00000100:00100000:2.0:1788535943.924306:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:2.0:1788535943.924317:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+36:11560:x1875415589276928:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788535943.924339:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535943.924359:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4701 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751594d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.924484:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d4708 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.924516:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d4708 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.924528:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d4708 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.924543:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d470f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.924550:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d470f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.924556:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d470f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788535943.926292:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788535943.926500:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51a00/0x74f51638375d4716 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.926515:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51a00/0x74f51638375d4716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.926527:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51a00/0x74f51638375d4716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.926562:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d4708 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.926570:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d4708 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.926578:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d4708 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.926593:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.926598:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d4708 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.926606:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d4708 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.926618:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:2.0:1788535943.926621:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535943.926626:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d4708 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.926632:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d4708 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535943.926646:0:5834:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000086eeffcf reply state 00000000db2c6692 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d470f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535943.926656:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788535943.926967:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4701 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751594d expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.926995:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51a00/0x74f51638375d4716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751594d expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.927003:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a99742a100) 00010000:00010000:2.0:1788535943.927006:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535943.927008:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc51a00, rc 0) 00000100:00100000:2.0:1788535943.927086:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+39:11560:x1875415589276928:12345-192.168.203.12@tcp:101:bash.0 Request processed in 2770us (3379us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788535943.927100:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 199 00010000:00010000:2.0:1788535943.930263:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d470f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.930280:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d470f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.930287:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d470f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.930292:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535943.930297:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d470f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.930304:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d470f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.930319:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a99742ad00) 00010000:00010000:2.0:1788535943.930323:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535943.930327:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d470f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.930332:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d470f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535943.931460:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535943.931699:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589277056 00000100:00100000:2.0:1788535943.931709:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589277056 00000100:00100000:2.0:1788535943.931767:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1788535943.931777:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+7:2355:x1875415589277056:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788535943.931795:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535943.931827:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000155f420/0x74f51638375d4724 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515954 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788535943.931855:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788535943.932122:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=346s v=(0 0) 00010000:00010000:2.0:1788535943.932128:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535943.932138:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000155f420/0x74f51638375d4724 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515954 expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.932161:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000155f420/0x74f51638375d4724 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515954 expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.932175:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc51000, rc 0) 00000100:00100000:2.0:1788535943.932511:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589277056:12345-192.168.203.12@tcp:101:bash.0 Request processed in 735us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535943.932518:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1788535943.936600:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535943.936746:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589277184 00000100:00100000:0.0:1788535943.936755:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589277184 00000100:00100000:0.0:1788535943.936845:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:0.0:1788535943.936854:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+8:11560:x1875415589277184:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788535943.936870:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535943.936926:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751595b expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.936956:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000155f420/0x74f51638375d4724 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515954 expref: 9 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.936979:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535943.936993:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535943.937000:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.937034:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000155f420/0x74f51638375d4724 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515954 expref: 9 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.937046:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000155f420/0x74f51638375d4724 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515954 expref: 9 pid: 6671 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535943.937060:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8424:1875415607091584:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535943.937315:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535943.940658:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535943.940739:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589277312 00000100:00100000:1.0:1788535943.940748:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589277312 00010000:00010000:1.0:1788535943.940784:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000155f420/0x74f51638375d4724 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515954 expref: 10 pid: 6671 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535943.940826:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1788535943.940845:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+10:2356:x1875415589277312:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535943.940861:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788535943.940877:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8424:1875415607091584:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535943.940919:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000155f420/0x74f51638375d4724 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515954 expref: 10 pid: 6671 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.940933:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000155f420/0x74f51638375d4724 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515954 expref: 10 pid: 6671 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.940968:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000155f420/0x74f51638375d4724 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515954 expref: 10 pid: 6671 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.940992:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.940996:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535943.941004:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535943.941057:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535943.941068:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535943.941082:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecb400, rc 0) 00010000:00010000:1.0:1788535943.941119:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535943.941135:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c46680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1875415607091712:192.168.203.12@tcp:105: 00000100:00100000:1.0:1788535943.941182:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9924cb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535943.941187:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+9:11560:x1875415589277184:12345-192.168.203.12@tcp:101:bash.0 Request processed in 4332us (4593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535943.941196:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:0.0:1788535943.944959:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c46680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1875415607091712:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788535943.945259:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535943.945426:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+8:2356:x1875415589277312:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4588us (4774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535943.945437:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:0.0:1788535943.946452:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535943.947566:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589277568 00000100:00100000:1.0:1788535943.947581:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589277568 00000100:00100000:1.0:1788535943.947678:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1788535943.947696:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+38:11560:x1875415589277568:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:1.0:1788535943.948116:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+39:11560:x1875415589277568:12345-192.168.203.12@tcp:35:bash.0 Request processed in 429us (1669us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788535943.948124:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00010000:00010000:2.0:1788535944.077207:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535944.087248:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535944.087324:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589277696 00000100:00100000:3.0:1788535944.087333:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589277696 00000100:00100000:3.0:1788535944.087452:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:3.0:1788535944.087464:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+39:11576:x1875415589277696:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535944.087504:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535944.087528:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4732 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515962 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.087588:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4739 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.087602:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.087613:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535944.087647:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788535944.087652:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788535944.087667:0:5833:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.087688:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4732 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515962 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.087708:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515962 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.087716:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:3.0:1788535944.087719:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788535944.087722:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980031c00, rc 0) 00000100:00100000:3.0:1788535944.087787:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+40:11576:x1875415589277696:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 326us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535944.087794:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00080000:2.0:1788535944.088442:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535944.095584:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535944.095727:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589277952 00000100:00100000:2.0:1788535944.095738:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589277952 00000100:00100000:2.0:1788535944.095978:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:2.0:1788535944.095991:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+40:11576:x1875415589277952:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788535944.096010:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535944.096029:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d4740 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515969 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.096123:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4747 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.096137:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.096148:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535944.096158:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788535944.096271:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51800/0x74f51638375d4740 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515969 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.096288:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4747 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515969 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.096296:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a99742a100) 00010000:00010000:2.0:1788535944.096299:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535944.096302:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc50000, rc 0) 00000100:00100000:2.0:1788535944.096363:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+42:11576:x1875415589277952:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 375us (787us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788535944.105476:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:1.0:1788535944.106002:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535944.106045:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589278208 00000100:00100000:1.0:1788535944.106047:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535944.106053:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589278208 00000100:00100000:2.0:1788535944.106100:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:2.0:1788535944.106110:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+42:11576:x1875415589278208:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788535944.106133:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535944.106152:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d4755 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515970 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.106257:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50600/0x74f51638375d475c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.106272:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50600/0x74f51638375d475c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.106282:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50600/0x74f51638375d475c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535944.106293:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788535944.106423:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d4755 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515970 expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.106440:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50600/0x74f51638375d475c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515970 expref: 44 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.106448:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a99742a100) 00010000:00010000:2.0:1788535944.106451:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788535944.106455:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc50600, rc 0) 00000100:00100000:2.0:1788535944.106515:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+44:11576:x1875415589278208:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 407us (515us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788535944.106532:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:3.0:1788535944.106588:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589278336 00000100:00100000:3.0:1788535944.106593:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589278336 00000100:00100000:3.0:1788535944.107528:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788535944.107542:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+44:2358:x1875415589278336:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535944.107555:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535944.107575:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4747 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515969 expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.107590:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a99742a100) 00010000:00010000:3.0:1788535944.107594:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535944.108993:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+43:2358:x1875415589278336:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1445us (2934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535944.109004:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788535944.113000:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535944.113058:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589278464 00000100:00100000:2.0:1788535944.113068:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589278464 00000100:00100000:2.0:1788535944.113136:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1788535944.113147:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589278464:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:0.0:1788535944.113217:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788535944.113219:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788535944.113256:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.113264:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535944.113268:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788535944.113273:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.113306:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.113319:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 8 pid: 8424 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535944.113332:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1875415607091840:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535944.113428:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fe780 going to sleep for 11 seconds 00000100:00100000:1.0:1788535944.119235:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535944.121982:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589278592 00000100:00100000:3.0:1788535944.121997:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589278592 00002000:00100000:3.0:1788535944.122055:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff97a9b6c44380 x1875415589278592/t0(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:600/0 lens 504/0 e 0 to 0 dl 1788535955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788535944.122066:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b6c44380 with x1875415589278592 ext(0->8) 00010000:00010000:3.0:1788535944.122076:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 9 pid: 8424 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.122092:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 9 pid: 8424 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788535944.122100:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97a9b6c44380 00000100:00100000:3.0:1788535944.122141:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:3.0:1788535944.122166:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:30a1922d-0d3f-4681-a966-cec3672631c6+9:2356:x1875415589278592:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:3.0:1788535944.122657:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:30a1922d-0d3f-4681-a966-cec3672631c6+11:2356:x1875415589278592:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 491us (3428us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788535944.122665:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00002000:00100000:3.0:1788535944.122673:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff97a9b6c44380 x1875415589278592/t4294967308(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:600/0 lens 504/448 e 0 to 0 dl 1788535955 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788535944.122682:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b6c44380 with x1875415589278592 ext(0->8) 00010000:00010000:3.0:1788535944.122689:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 11 pid: 8424 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.122702:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 11 pid: 8424 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788535944.122709:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97a9b6c44380 00000100:00100000:0.0:1788535944.123363:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1875415607091840:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535944.123391:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535944.125179:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535944.125262:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589278720 00000100:00100000:3.0:1788535944.125271:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589278720 00010000:00010000:3.0:1788535944.125306:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 11 pid: 8424 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535944.125345:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:3.0:1788535944.125354:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+11:2355:x1875415589278720:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535944.125367:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788535944.125384:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788535944.125387:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788535944 00002000:00010000:3.0:1788535944.125389:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788535944 00002000:00010000:3.0:1788535944.125402:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788535944 00010000:00010000:3.0:1788535944.125422:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 11 pid: 8424 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.125436:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 11 pid: 8424 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.125458:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c51c31ef/0x74f51638375d472b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751595b expref: 11 pid: 8424 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.125474:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535944.125478:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535944.125484:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.125494:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.125570:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535944.125640:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+10:2355:x1875415589278720:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 286us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535944.125648:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00010000:00010000:1.0:1788535944.126972:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.126990:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.127020:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.127028:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.127036:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.127042:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788535944.127046:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.127055:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.127074:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.127096:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006377cd3/0x74f51638375d476a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535944.127260:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+9:2355:x1875415589278464:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 14111us (14266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535944.127270:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:3.0:1788535944.128718:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535944.128821:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589278976 00000100:00100000:2.0:1788535944.128831:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589278976 00000100:00100000:1.0:1788535944.128986:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:1.0:1788535944.128997:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99c78b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+43:11576:x1875415589278976:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:1.0:1788535944.129056:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50600/0x74f51638375d475c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515970 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788535944.129428:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788535944.129476:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788535944.130098:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788535944.130356:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.130374:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51a00/0x74f51638375d4716 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751594d expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.130383:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.130431:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51a00/0x74f51638375d4716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751594d expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.130447:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51a00/0x74f51638375d4716 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751594d expref: 47 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535944.130611:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c44000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875415607091968:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788535944.130701:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9924cb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535944.135441:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535944.135654:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589279104 00000100:00100000:3.0:1788535944.135664:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589279104 00010000:00010000:3.0:1788535944.135710:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51a00/0x74f51638375d4716 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751594d expref: 48 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535944.135760:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1788535944.135770:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+48:2356:x1875415589279104:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535944.135784:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535944.135792:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51a00/0x74f51638375d4716 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751594d expref: 48 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.135825:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51a00/0x74f51638375d4716 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751594d expref: 48 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.135847:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a99742a100) 00010000:00010000:3.0:1788535944.135852:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.135861:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.135868:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.135918:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535944.135972:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+48:2356:x1875415589279104:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 203us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535944.135980:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00010000:00010000:0.0:1788535944.137714:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51a00/0x74f51638375d4716 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751594d expref: 47 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535944.137884:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c44000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875415607091968:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535944.137936:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.137946:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.137952:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788535944.138082:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788535944.139902:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788535944.140043:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c4df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607092096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788535944.140108:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535944.140155:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9a06f2780 going to sleep for 11 seconds 00000100:00100000:1.0:1788535944.140209:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607092096 00000100:00100000:1.0:1788535944.140218:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607092096 00000100:00100000:1.0:1788535944.140273:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788535944.140283:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1875415607092096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788535944.140366:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1875415607092096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535944.140374:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788535944.140651:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c4df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607092096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788535944.145464:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788535944.145566:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c4df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607092224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788535944.147132:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535944.147209:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b9306cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535944.148074:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607092224 00000100:00100000:1.0:1788535944.148084:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607092224 00000100:00100000:1.0:1788535944.148247:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788535944.148258:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1875415607092224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788535944.148500:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5836:x1875415607092224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 243us (1372us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788535944.148508:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788535944.148583:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c4df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875415607092224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788535944.148671:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788535944.148728:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.148739:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.148747:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.148770:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ae00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535944.148775:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.148782:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.148797:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a99742a100) 00010000:00010000:0.0:1788535944.148800:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788535944.148805:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.148811:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d4771 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788535944.149035:0:5836:0:(mdd_object.c:4338:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788535944.149129:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788535944.149147:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346280258640ns, next at 347280256697ns, rc = 0 00000001:00080000:0.0:1788535944.149154:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788535944.149184:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a99742a100) 00010000:00010000:0.0:1788535944.149187:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788535944.149195:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50600/0x74f51638375d475c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515970 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535944.149294:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99c78b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+50:11576:x1875415589278976:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 20299us (20581us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788535944.149302:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000020:00080000:0.0:1788535944.149306:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788535944.152514:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535944.152599:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589279232 00000100:00100000:0.0:1788535944.152667:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589279232 00000100:00100000:0.0:1788535944.152827:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:0.0:1788535944.152838:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+50:11576:x1875415589279232:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535944.152861:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535944.152920:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d4778 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515977 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.152977:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d4778 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515977 expref: 51 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.152992:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d4778 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515977 expref: 51 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.153009:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:0.0:1788535944.153012:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788535944.153016:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987eca400, rc 0) 00000100:00100000:0.0:1788535944.153061:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+51:11576:x1875415589279232:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 225us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535944.153067:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:2.0:1788535944.160480:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535944.160579:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589279488 00000100:00100000:1.0:1788535944.160588:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589279488 00000100:00100000:1.0:1788535944.160806:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788535944.160825:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+51:11576:x1875415589279488:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788535944.161082:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+52:11576:x1875415589279488:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 266us (609us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788535944.161106:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788535944.236748:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535944.236842:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589279616 00000100:00100000:2.0:1788535944.236852:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589279616 00000100:00100000:2.0:1788535944.236943:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:2.0:1788535944.236954:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+52:11586:x1875415589279616:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1788535944.237031:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d477f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237049:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d477f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237060:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d477f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237076:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4786 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237083:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237090:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237215:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d478d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237225:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d478d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237232:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d478d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535944.237275:0:5832:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d478d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237287:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d477f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237294:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d477f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237300:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d477f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237306:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50e00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535944.237310:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d477f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237317:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d477f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237329:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:2.0:1788535944.237333:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535944.237338:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d477f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237351:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d477f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237365:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237371:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4786 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237376:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4786 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237381:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535944.237385:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4786 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237391:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4786 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237399:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a99742ad00) 00010000:00010000:2.0:1788535944.237402:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535944.237416:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4786 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237423:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d4786 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237438:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d478d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237444:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d478d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237457:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d478d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237462:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535944.237466:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d478d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237472:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d478d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237482:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:2.0:1788535944.237485:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535944.237488:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d478d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.237494:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d478d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535944.237574:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+52:11586:x1875415589279616:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 620us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535944.237583:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 204 00000040:00080000:3.0:1788535944.271926:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535944.271934:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788535944.272103:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788535944.272110:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788535944.293307:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535944.293418:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589279872 00000100:00100000:2.0:1788535944.293428:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589279872 00000100:00100000:2.0:1788535944.293490:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:2.0:1788535944.293500:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+52:11589:x1875415589279872:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788535944.293521:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535944.293544:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d4794 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751597e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293636:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d479b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293652:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d479b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293663:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d479b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293677:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d47a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293683:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d47a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293703:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d47a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293808:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d47a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293817:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d47a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293824:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d47a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535944.293832:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788535944.293950:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d479b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293958:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d479b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293971:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d479b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293977:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535944.293982:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d479b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293989:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d479b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.293999:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:2.0:1788535944.294002:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535944.294006:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d479b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.294012:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50000/0x74f51638375d479b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.294023:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d47a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.294028:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d47a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.294034:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d47a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.294039:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50e00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535944.294042:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d47a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.294056:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d47a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.294063:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a99742ad00) 00010000:00010000:2.0:1788535944.294065:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535944.294067:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d47a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.294073:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50e00/0x74f51638375d47a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.294107:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51000/0x74f51638375d4794 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751597e expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.294118:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d47a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751597e expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535944.294125:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:2.0:1788535944.294127:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535944.294129:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc51200, rc 0) 00000100:00100000:2.0:1788535944.294182:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+54:11589:x1875415589279872:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 684us (887us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788535944.294189:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:3.0:1788535944.298350:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535944.298483:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589280000 00000100:00100000:0.0:1788535944.298493:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589280000 00000100:00100000:0.0:1788535944.298554:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:0.0:1788535944.298565:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+54:11589:x1875415589280000:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788535944.298632:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.298648:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.298672:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.298698:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.298706:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.298712:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.298719:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535944.298723:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.298730:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.298742:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:0.0:1788535944.298745:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788535944.298749:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.298756:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535944.298828:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+54:11589:x1875415589280000:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 265us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535944.298836:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:1.0:1788535944.302712:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535944.302776:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589280256 00000100:00100000:0.0:1788535944.302786:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589280256 00000100:00100000:0.0:1788535944.302844:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:0.0:1788535944.302854:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+54:11589:x1875415589280256:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788535944.303115:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+55:11589:x1875415589280256:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 262us (412us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788535944.303123:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:1.0:1788535944.394864:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535944.395167:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589280512 00000100:00100000:3.0:1788535944.395177:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589280512 00000100:00100000:3.0:1788535944.395272:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:3.0:1788535944.395281:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+55:11599:x1875415589280512:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788535944.395301:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535944.395303:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788535944.395325:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4739 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515962 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.395341:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:3.0:1788535944.395344:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535944.395354:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d47be lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515985 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.395460:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.395475:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d47a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751597e expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.395483:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.395518:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d47a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751597e expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.395532:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d47a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751597e expref: 55 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535944.395567:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9232680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875415607092352:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788535944.395931:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988780b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535944.399367:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9232680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875415607092352:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788535944.399416:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535944.399591:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535944.399789:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589280640 00000100:00100000:3.0:1788535944.399797:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589280640 00010000:00010000:3.0:1788535944.399830:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d47a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751597e expref: 56 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535944.399883:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:3.0:1788535944.399916:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+56:2355:x1875415589280640:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535944.399929:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535944.399937:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d47a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751597e expref: 56 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.399950:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d47a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751597e expref: 56 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.399972:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc51200/0x74f51638375d47a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751597e expref: 56 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.399987:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:3.0:1788535944.399992:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.400014:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.400022:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.400049:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535944.400105:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+55:2355:x1875415589280640:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 191us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535944.400112:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00010000:00010000:1.0:1788535944.400601:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.400610:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535944.400628:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788535944.400781:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d47be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515985 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.400800:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515985 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.400808:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:1.0:1788535944.400810:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788535944.400813:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980030600, rc 0) 00000100:00100000:1.0:1788535944.400864:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+55:11599:x1875415589280512:12345-192.168.203.12@tcp:101:bash.0 Request processed in 5584us (6009us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788535944.400873:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:1.0:1788535944.408244:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535944.408403:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589280896 00000100:00100000:3.0:1788535944.408424:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589280896 00000100:00100000:3.0:1788535944.408492:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:3.0:1788535944.408503:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+55:11599:x1875415589280896:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:3.0:1788535944.408761:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.408779:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.408792:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535944.408845:0:6697:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788535944.408869:0:6697:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000005423d473 reply state 00000000fb949c6c transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535944.408877:0:6697:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535944.408991:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+58:11599:x1875415589280896:12345-192.168.203.12@tcp:36:bash.0 Request processed in 489us (755us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788535944.409017:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 208 00000020:00080000:3.0:1788535944.409022:0:6697:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788535944.417091:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1788535944.417483:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.417496:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.417504:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.417510:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980031c00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535944.417516:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.417523:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.417541:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:3.0:1788535944.417544:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535944.417548:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.417555:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535944.421388:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589281024 00000100:00100000:0.0:1788535944.421402:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589281024 00000100:00100000:0.0:1788535944.421480:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:0.0:1788535944.421489:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+57:11599:x1875415589281024:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788535944.421511:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535944.421530:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751598c expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.421606:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.421620:0:11644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515985 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.421629:0:11644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.421661:0:11644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515985 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.421674:0:11644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515985 expref: 58 pid: 5833 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535944.421699:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607092480:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535944.421774:0:11644:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fe780 going to sleep for 11 seconds 00000100:00100000:0.0:1788535944.423722:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607092480:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535944.423750:0:11644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535944.428654:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535944.428742:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589281152 00000100:00100000:3.0:1788535944.428752:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589281152 00010000:00010000:3.0:1788535944.428793:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515985 expref: 59 pid: 5833 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535944.428853:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:3.0:1788535944.428864:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+59:2355:x1875415589281152:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535944.428878:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535944.428919:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515985 expref: 59 pid: 5833 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.428933:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515985 expref: 59 pid: 5833 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.428955:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515985 expref: 59 pid: 5833 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.428972:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:3.0:1788535944.428978:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.428988:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.429002:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.429025:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535944.429085:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+58:2355:x1875415589281152:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 223us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535944.429093:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00010000:00010000:0.0:1788535944.429823:0:11644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.429834:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535944.429916:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788535944.429921:0:11644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535944.429944:0:11644:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.429977:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751598c expref: 58 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.429995:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751598c expref: 57 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.430003:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:0.0:1788535944.430006:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535944.430008:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecb600, rc 0) 00000100:00100000:0.0:1788535944.430057:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+57:11599:x1875415589281024:12345-192.168.203.12@tcp:101:bash.0 Request processed in 8569us (12977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535944.430076:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:2.0:1788535944.437630:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535944.437720:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589281408 00000100:00100000:0.0:1788535944.437730:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589281408 00000100:00100000:0.0:1788535944.437786:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:0.0:1788535944.437797:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+57:11599:x1875415589281408:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:0.0:1788535944.438080:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+58:11599:x1875415589281408:12345-192.168.203.12@tcp:35:bash.0 Request processed in 284us (459us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788535944.438088:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1788535944.498316:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535944.498421:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589281536 00000100:00100000:3.0:1788535944.498455:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589281536 00000100:00100000:3.0:1788535944.498516:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:3.0:1788535944.498526:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+58:11605:x1875415589281536:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788535944.498550:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535944.498570:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515993 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.498654:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.498668:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.498679:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535944.498715:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788535944.498719:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788535944.499284:0:5833:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.499314:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d47e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515993 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.499333:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515993 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535944.499341:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:3.0:1788535944.499344:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788535944.499347:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980031c00, rc 0) 00000100:00100000:3.0:1788535944.499425:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+59:11605:x1875415589281536:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 900us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535944.499433:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:3.0:1788535944.512369:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535944.513867:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589281664 00000100:00100000:0.0:1788535944.513881:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589281664 00000100:00100000:0.0:1788535944.513956:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:0.0:1788535944.513966:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+59:11605:x1875415589281664:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535944.513986:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535944.514005:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f9751599a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514064:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecac00/0x74f51638375d47fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514078:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecac00/0x74f51638375d47fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514088:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecac00/0x74f51638375d47fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514101:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4804 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514124:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514130:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514216:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d480b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514225:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d480b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514231:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d480b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535944.514342:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788535944.514346:0:6697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535944.514366:0:6697:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d480b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514378:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d480b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514386:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecac00/0x74f51638375d47fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514391:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecac00/0x74f51638375d47fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514397:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecac00/0x74f51638375d47fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514423:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecac00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535944.514427:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecac00/0x74f51638375d47fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514435:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecac00/0x74f51638375d47fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514447:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:0.0:1788535944.514450:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535944.514454:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecac00/0x74f51638375d47fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514460:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecac00/0x74f51638375d47fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514473:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514479:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4804 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514485:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4804 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514489:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecba00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535944.514492:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4804 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514497:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4804 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514515:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a9a0685800) 00010000:00010000:0.0:1788535944.514517:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535944.514520:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4804 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514527:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4804 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514557:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d47f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751599a expref: 61 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514570:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d480b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751599a expref: 60 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.514578:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:0.0:1788535944.514580:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535944.514582:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecbc00, rc 0) 00000100:00100000:0.0:1788535944.514649:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+60:11605:x1875415589281664:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 684us (2290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535944.514656:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:3.0:1788535944.518344:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535944.518434:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589281792 00000100:00100000:0.0:1788535944.518444:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589281792 00000100:00100000:0.0:1788535944.518516:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788535944.518526:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+60:2355:x1875415589281792:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535944.518541:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535944.518567:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d480b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751599a expref: 60 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.518605:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:0.0:1788535944.518609:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535944.518665:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+59:2355:x1875415589281792:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 140us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535944.518672:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788535944.520036:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535944.520125:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589282048 00000100:00100000:0.0:1788535944.520133:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589282048 00000100:00100000:0.0:1788535944.520190:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:0.0:1788535944.520199:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+59:11605:x1875415589282048:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535944.520217:0:11644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535944.520247:0:11644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d4812 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159a1 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.520350:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.520363:0:11644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751598c expref: 60 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.520372:0:11644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.520402:0:11644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751598c expref: 60 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.520427:0:11644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751598c expref: 60 pid: 11644 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535944.520454:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607092608:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535944.520534:0:11644:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fe780 going to sleep for 11 seconds 00000100:00100000:3.0:1788535944.523877:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535944.526638:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589282176 00000100:00100000:1.0:1788535944.526653:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589282176 00010000:00010000:1.0:1788535944.526703:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751598c expref: 61 pid: 11644 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535944.526750:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:1.0:1788535944.526761:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+61:2355:x1875415589282176:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535944.526775:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535944.526783:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751598c expref: 61 pid: 11644 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.526797:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751598c expref: 61 pid: 11644 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.526821:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:1.0:1788535944.526826:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.526836:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.526843:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.526863:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535944.526953:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+61:2355:x1875415589282176:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 194us (3086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535944.526960:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00010000:00010000:0.0:1788535944.527150:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d47e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751598c expref: 60 pid: 11644 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535944.527165:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607092608:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535944.527184:0:11644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.527192:0:11644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.527197:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535944.527214:0:11644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788535944.527363:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb400/0x74f51638375d4812 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a1 expref: 61 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.527377:0:11644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a1 expref: 60 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.527383:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:0.0:1788535944.527386:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788535944.527388:0:11644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecba00, rc 0) 00000100:00100000:0.0:1788535944.527422:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+60:11605:x1875415589282048:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 7226us (7394us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788535944.527442:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:3.0:1788535944.530304:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535944.530452:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589282432 00000100:00100000:0.0:1788535944.530464:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589282432 00000100:00100000:0.0:1788535944.530529:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788535944.530539:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9230e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+60:11605:x1875415589282432:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:0.0:1788535944.530555:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535944.530582:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d4778 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515977 expref: 60 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.530600:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:0.0:1788535944.530604:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535944.530662:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9230e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+59:11605:x1875415589282432:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 125us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535944.530670:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788535944.534821:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535944.539398:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589282560 00000100:00100000:1.0:1788535944.539438:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589282560 00000100:00100000:1.0:1788535944.539718:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:1.0:1788535944.539730:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+59:11605:x1875415589282560:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:1.0:1788535944.539831:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4827 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.539848:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4827 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535944.539860:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4827 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788535944.540050:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788535944.540130:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+59:11605:x1875415589282560:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 402us (5319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535944.540137:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:3.0:1788535944.544378:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535944.544528:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589282688 00000100:00100000:0.0:1788535944.544539:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589282688 00000100:00100000:0.0:1788535944.544606:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:0.0:1788535944.544617:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+59:11605:x1875415589282688:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535944.544638:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535944.544658:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d482e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159a8 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.544746:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4827 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.544759:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d482e lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a8 expref: 60 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.544786:0:6697:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4827 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.544801:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d482e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a8 expref: 60 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.544816:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:0.0:1788535944.544820:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788535944.544825:0:6697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d482e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a8 expref: 60 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535944.544833:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecbc00, rc 0) 00000100:00100000:0.0:1788535944.544919:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+60:11605:x1875415589282688:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 304us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535944.544927:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 214 00000001:00080000:3.0:1788535945.058280:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:3.0:1788535945.058298:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1788535945.058311:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788535945.058320:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:2.0:1788535945.101413:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788535945.293266:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535945.293274:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788535945.293382:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788535945.293389:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788535945.293524:0:11640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9230700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11640:1875415607092736:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788535945.293627:0:11640:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98895ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535945.296317:0:11640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9230700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11640:1875415607092736:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788535945.298630:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535945.299654:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589282816 00000100:00100000:1.0:1788535945.300134:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589282816 00000100:00100000:1.0:1788535945.300208:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:1.0:1788535945.300219:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+60:11606:x1875415589282816:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788535945.300253:0:11644:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788535945.301193:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+60:11606:x1875415589282816:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 969us (2565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535945.301205:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:3.0:1788535945.307632:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535945.307739:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589282944 00000100:00100000:0.0:1788535945.307750:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589282944 00000100:00100000:0.0:1788535945.307821:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:0.0:1788535945.307831:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+60:11606:x1875415589282944:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788535945.307947:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4835 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308262:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4835 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308274:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4835 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308325:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d483c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308331:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d483c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308335:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d483c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308353:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4843 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308357:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308361:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535945.308395:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788535945.308408:0:6697:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535945.308421:0:6697:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308432:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4835 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308439:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4835 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308446:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4835 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308526:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535945.308530:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4835 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308536:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4835 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308548:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a99742a400) 00010000:00010000:0.0:1788535945.308551:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535945.308555:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4835 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308561:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4835 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308574:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d483c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308581:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d483c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308587:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d483c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308592:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535945.308595:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d483c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308601:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d483c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308626:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff97a9a0685a00) 00010000:00010000:0.0:1788535945.308628:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535945.308631:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d483c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308637:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d483c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308651:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308657:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4843 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308662:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308667:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535945.308669:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308731:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4843 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308740:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:0.0:1788535945.308742:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535945.308746:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4843 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.308751:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb000/0x74f51638375d4843 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535945.309156:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+60:11606:x1875415589282944:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 1324us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535945.309166:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:0.0:1788535945.313741:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535945.313863:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589283200 00000100:00100000:1.0:1788535945.314114:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589283200 00000100:00100000:1.0:1788535945.314174:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:1.0:1788535945.314184:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+60:11606:x1875415589283200:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788535945.314220:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535945.314241:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d484a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.314339:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.314353:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.314363:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535945.314374:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788535945.314629:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.314637:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4851 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.314644:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.314650:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535945.314654:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.314835:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.314850:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:1.0:1788535945.314859:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788535945.315126:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4851 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.315136:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.315180:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d484a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159af expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.315191:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a99742a400) 00010000:00010000:1.0:1788535945.315193:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788535945.315197:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d484a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159af expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.315207:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0aa00, rc 0) 00000100:00100000:1.0:1788535945.315304:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+61:11606:x1875415589283200:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1121us (1570us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1788535945.315311:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:1.0:1788535945.327176:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535945.327330:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589283328 00000100:00100000:2.0:1788535945.327339:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589283328 00000100:00100000:2.0:1788535945.327396:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:2.0:1788535945.327414:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+61:11606:x1875415589283328:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788535945.327460:0:5834:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788535945.327561:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+61:11606:x1875415589283328:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 147us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535945.327568:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:2.0:1788535945.337386:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535945.337633:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589283584 00000100:00100000:0.0:1788535945.337645:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589283584 00000100:00100000:0.0:1788535945.338269:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:0.0:1788535945.338282:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+61:11606:x1875415589283584:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535945.338301:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535945.338304:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788535945.338328:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d47ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515993 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.338347:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:0.0:1788535945.338351:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788535945.338363:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d485f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159b6 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788535945.340080:0:6697:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788535945.340313:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4866 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.340330:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.340341:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.340435:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d485f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159b6 expref: 63 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.340465:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159b6 expref: 62 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.340475:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a9a0685a00) 00010000:00010000:0.0:1788535945.340478:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535945.340481:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecb600, rc 0) 00000100:00100000:0.0:1788535945.341224:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+62:11606:x1875415589283584:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 2938us (3842us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788535945.341233:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:0.0:1788535945.349441:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535945.349536:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589283840 00000100:00100000:1.0:1788535945.349555:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589283840 00000100:00100000:1.0:1788535945.349614:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:1.0:1788535945.349624:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+62:11606:x1875415589283840:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788535945.349691:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535945.349718:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4866 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159b6 expref: 62 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.349767:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a9a0685a00) 00010000:00010000:1.0:1788535945.349779:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535945.349801:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4874 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.349814:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4874 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.349824:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4874 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.349838:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d487b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x760fdb4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.349846:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d487b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x760fdb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.349853:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d487b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x760fdb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.349961:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4874 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.349969:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4874 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.349976:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4874 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.349982:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0aa00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535945.349986:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4874 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.350000:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4874 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.350010:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:1.0:1788535945.350013:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535945.350016:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4874 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.350022:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0aa00/0x74f51638375d4874 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.350031:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d487b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x760fdb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.350037:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d487b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x760fdb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.350042:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d487b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x760fdb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.350047:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535945.350050:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d487b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x760fdb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.350056:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d487b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x760fdb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.350063:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x760fdb4 (ffff97a9888ad200) 00010000:00010000:1.0:1788535945.350065:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535945.350068:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d487b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x760fdb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.350084:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d487b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x760fdb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535945.354571:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+61:11606:x1875415589283840:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 4936us (5126us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788535945.354584:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:2.0:1788535945.374603:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535945.374885:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589283968 00000100:00100000:3.0:1788535945.374920:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589283968 00000100:00100000:3.0:1788535945.374978:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:3.0:1788535945.374988:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+61:11606:x1875415589283968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535945.375009:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535945.375035:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d4882 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159bd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.375097:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4889 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.375112:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.375125:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.375220:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d4882 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159bd expref: 63 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.375238:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4889 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159bd expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.375246:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a997503c00) 00010000:00010000:3.0:1788535945.375249:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788535945.375252:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980031c00, rc 0) 00000100:00100000:3.0:1788535945.375301:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+62:11606:x1875415589283968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 315us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535945.375308:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:2.0:1788535945.378187:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535945.378803:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589284224 00000100:00100000:3.0:1788535945.378814:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589284224 00000100:00100000:3.0:1788535945.380097:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:3.0:1788535945.380118:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+62:11606:x1875415589284224:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788535945.380201:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4890 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.380234:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.380245:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788535945.381926:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788535945.381944:0:6697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347513055568ns, next at 348513052037ns, rc = 0 00000004:00010000:3.0:1788535945.382055:0:6697:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000cf85fde2 reply state 00000000544fa9cd transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535945.382067:0:6697:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535945.382202:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+64:11606:x1875415589284224:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 2089us (4019us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788535945.388358:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535945.388836:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589284352 00000100:00100000:2.0:1788535945.388918:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589284352 00000100:00100000:2.0:1788535945.388971:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:2.0:1788535945.388981:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+65:11606:x1875415589284352:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535945.389004:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535945.389023:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4897 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.389083:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4897 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159c4 expref: 66 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.389104:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4897 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159c4 expref: 66 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.389123:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a997503c00) 00010000:00010000:2.0:1788535945.389140:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788535945.389144:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc50a00, rc 0) 00000100:00100000:2.0:1788535945.389328:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+66:11606:x1875415589284352:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 347us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535945.389335:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 223 00010000:00010000:1.0:1788535945.390111:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.390124:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4890 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.390132:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4890 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.390138:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980031e00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788535945.390143:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4890 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.390151:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4890 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.390165:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a997503c00) 00010000:00010000:1.0:1788535945.390168:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788535945.390172:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4890 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.390178:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031e00/0x74f51638375d4890 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535945.394143:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:1.0:1788535945.405388:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535945.405692:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589284480 00000100:00100000:3.0:1788535945.405701:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589284480 00000100:00100000:3.0:1788535945.405951:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1788535945.405963:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+9:2358:x1875415589284480:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788535945.406015:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535945.409004:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+10:2358:x1875415589284480:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 520us (1103us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788535945.409022:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:2.0:1788535945.415936:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535945.416066:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589284736 00000100:00100000:0.0:1788535945.416077:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589284736 00000100:00100000:0.0:1788535945.416195:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:0.0:1788535945.416207:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+64:11606:x1875415589284736:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788535945.416499:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+65:11606:x1875415589284736:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 293us (610us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788535945.416508:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:0.0:1788535945.420166:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535945.420231:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589284992 00000100:00100000:1.0:1788535945.420242:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589284992 00000100:00100000:1.0:1788535945.420300:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:1.0:1788535945.420310:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+65:11606:x1875415589284992:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788535945.420686:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+65:11606:x1875415589284992:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 370us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535945.420695:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:2.0:1788535945.423866:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535945.424409:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589285120 00000100:00100000:0.0:1788535945.424421:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589285120 00000100:00100000:0.0:1788535945.424588:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:0.0:1788535945.424614:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+65:11606:x1875415589285120:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535945.424635:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535945.424657:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d489e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159cb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.424735:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d48a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.424752:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d48a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.424765:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d48a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535945.424806:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788535945.424827:0:5832:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d48a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.424855:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d489e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159cb expref: 67 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.424874:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d48a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159cb expref: 66 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.424883:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a997503c00) 00010000:00010000:0.0:1788535945.424932:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788535945.424936:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987eca200, rc 0) 00000100:00100000:0.0:1788535945.426136:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+66:11606:x1875415589285120:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1518us (2275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535945.426161:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:3.0:1788535945.432154:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535945.432436:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589285248 00000100:00100000:0.0:1788535945.432447:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589285248 00000100:00100000:0.0:1788535945.432631:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1788535945.432641:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+10:2355:x1875415589285248:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535945.432671:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535945.432693:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159d2 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535945.432720:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ae489, blocks: 0x1 00010000:00010000:0.0:1788535945.432741:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1788535945.432745:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535945.432755:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d2 expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.432784:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d2 expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.432798:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987eca800, rc 0) 00000100:00100000:0.0:1788535945.432860:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+11:2355:x1875415589285248:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 220us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535945.433124:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1788535945.439732:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535945.439929:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589285504 00000100:00100000:0.0:1788535945.439939:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589285504 00000100:00100000:2.0:1788535945.440205:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:2.0:1788535945.440217:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+66:11606:x1875415589285504:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788535945.440316:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+66:11606:x1875415589285504:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 101us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535945.440323:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:2.0:1788535945.454311:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535945.454549:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589285632 00000100:00100000:0.0:1788535945.454559:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589285632 00000100:00100000:0.0:1788535945.454632:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:0.0:1788535945.454641:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+11:11606:x1875415589285632:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535945.454665:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535945.454684:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d48b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159d9 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.454715:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d2 expref: 12 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.454883:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535945.455073:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535945.455081:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d48b3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d9 expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.455119:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d2 expref: 12 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.455183:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d2 expref: 12 pid: 6673 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535945.455272:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8424:1875415607092864:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535945.455422:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9975793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535945.458814:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535945.459098:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589285760 00000100:00100000:1.0:1788535945.459110:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589285760 00010000:00010000:1.0:1788535945.459260:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48ac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d2 expref: 13 pid: 6673 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535945.459338:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1788535945.459347:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+13:2356:x1875415589285760:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535945.459361:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535945.459383:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48ac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d2 expref: 13 pid: 6673 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.459405:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d2 expref: 13 pid: 6673 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.459430:0:7598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535945.459434:0:7598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535945.459449:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d48b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d9 expref: 13 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.459472:0:7598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d48b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d9 expref: 13 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.459504:0:7598:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d48b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d9 expref: 13 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535945.459517:0:7598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7598:1875415607092992:192.168.203.12@tcp:105: 00000100:00100000:1.0:1788535945.459600:0:7598:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99855fd80 going to sleep for 11 seconds 00010000:00010000:0.0:1788535945.462071:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d2 expref: 13 pid: 6673 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535945.462099:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8424:1875415607092864:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788535945.462286:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d48b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d9 expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.462301:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecaa00, rc 0) 00000100:00100000:0.0:1788535945.462430:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+12:11606:x1875415589285632:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 7789us (8129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535945.462438:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1788535945.467174:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535945.467329:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589285888 00000100:00100000:2.0:1788535945.467339:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589285888 00002000:00100000:2.0:1788535945.467410:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff97a9b9233800 x1875415589285888/t0(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:601/0 lens 504/0 e 0 to 0 dl 1788535956 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788535945.467420:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b9233800 with x1875415589285888 ext(0->12) 00000100:00100000:1.0:1788535945.467421:0:7598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7598:1875415607092992:192.168.203.12@tcp:105: 00002000:00010000:2.0:1788535945.467426:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a9b9233800 00010000:00010000:1.0:1788535945.467443:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535945.467463:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788535945.467472:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:30a1922d-0d3f-4681-a966-cec3672631c6+12:2355:x1875415589285888:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788535945.467491:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+12:2356:x1875415589285760:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 8145us (8687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535945.467500:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:2.0:1788535945.469421:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:30a1922d-0d3f-4681-a966-cec3672631c6+13:2355:x1875415589285888:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 1941us (2250us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788535945.469435:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00002000:00100000:2.0:1788535945.469451:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff97a9b9233800 x1875415589285888/t4294967320(0) o4->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:601/0 lens 504/448 e 0 to 0 dl 1788535956 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788535945.469461:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b9233800 with x1875415589285888 ext(0->12) 00002000:00010000:2.0:1788535945.469466:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a9b9233800 00000100:00100000:3.0:1788535945.489665:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535945.489792:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589286016 00000100:00100000:1.0:1788535945.489802:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589286016 00000100:00100000:1.0:1788535945.489870:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:1.0:1788535945.489882:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+66:11606:x1875415589286016:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788535945.544045:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788535945.544066:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788535945.544090:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a9a06f2e40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788535945.544095:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9b74e6500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a9a06f2780 00000020:00080000:0.0:1788535945.544098:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9b74e6700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a9bf277400 00000020:00080000:0.0:1788535945.544118:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a9b6c14540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788535945.544122:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9b74e6c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a9b6c149c0 00000020:00080000:0.0:1788535945.544125:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9b74e6200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a9b7339c00 00000020:00080000:0.0:1788535945.544138:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 4 00000020:00080000:0.0:1788535945.544326:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788535945.544519:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9231180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607093120:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788535945.544590:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788535945.545287:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788535945.545325:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1788535945.545331:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:2.0:1788535945.545504:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607093376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788535945.545548:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535945.545586:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607093248:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788535945.545614:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535945.545909:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+20:11606:x1875415589286016:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 56027us (56255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535945.545920:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:2.0:1788535945.547293:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607093120 00000100:00100000:2.0:1788535945.547305:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607093120 00000100:00100000:2.0:1788535945.547361:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607093376 00000100:00100000:2.0:1788535945.547365:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607093376 00000100:00100000:2.0:1788535945.547381:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607093248 00000100:00100000:2.0:1788535945.547384:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607093248 00000100:00100000:2.0:1788535945.547409:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788535945.547418:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607093120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788535945.547444:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1788535945.547477:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ae488, atime: 0x6a9ae488, ctime: 0x6a9ae488, blocks: 0xb 00010000:00010000:2.0:1788535945.547485:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d48ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.547500:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1788535945.547504:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535945.547511:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d48ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.547526:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d48ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.547554:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d48ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.547561:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d48ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.547579:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1788535945.548184:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535945.548189:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535945.548208:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788535945.548220:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875415607093376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788535945.548379:0:8424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788535945.548383:0:8424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788535945 00002000:00010000:0.0:1788535945.548385:0:8424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788535945.548387:0:8424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788535945 -> 1788535945 00002000:00010000:0.0:1788535945.548390:0:8424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788535945.548467:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3309:x1875415607093376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 249us (2917us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788535945.548474:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788535945.548494:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788535945.548501:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875415607093248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788535945.548513:0:8424:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1788535945.548527:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.548543:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d467c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515938 expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.548552:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788535945.548556:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788535945.548559:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.548591:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d467c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515938 expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.548616:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d467c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515938 expref: 12 pid: 8424 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535945.548631:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8424:1875415607093504:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535945.548880:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a997579a80 going to sleep for 11 seconds 00000004:00080000:0.0:1788535945.549040:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a9b61ad180/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788535945.549048:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607093376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788535945.552061:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535945.552129:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535945.552150:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788535945.552159:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:3.0:1788535945.552960:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535945.552970:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d48ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.552983:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51600 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788535945.552987:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d48ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.552998:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d48ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.553017:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d48ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.553025:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d48ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.553048:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535945.553050:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535945.553052:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535945.553427:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875415607093120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6008us (8834us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788535945.553438:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788535945.553569:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589286144 00000100:00100000:2.0:1788535945.553579:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589286144 00000100:00100000:2.0:1788535945.553610:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:2.0:1788535945.553618:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+13:2356:x1875415589286144:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788535945.553789:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589286272 00000100:00100000:0.0:1788535945.553794:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589286272 00010000:00010000:0.0:1788535945.553819:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d467c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515938 expref: 14 pid: 8424 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535945.553849:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:0.0:1788535945.553857:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+14:2356:x1875415589286272:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535945.553867:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535945.553873:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d467c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515938 expref: 14 pid: 8424 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.553905:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d467c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515938 expref: 14 pid: 8424 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.553926:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788535945.553931:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788535945.553950:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.553960:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.553981:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535945.554023:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+14:2356:x1875415589286272:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 166us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535945.554030:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00010000:00010000:1.0:1788535945.554607:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d467c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515938 expref: 13 pid: 8424 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535945.554644:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8424:1875415607093504:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788535945.554664:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.554683:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.554690:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.554700:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.554707:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.554726:0:8424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788535945.555251:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3308:x1875415607093248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6749us (9635us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788535945.555260:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1788535945.555600:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535945.555608:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.555617:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca800 already unused, calling callback (ffffffffc1455530) 00010000:00010000:2.0:1788535945.555622:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.555640:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.555682:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.555689:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d48c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.555709:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535945.555711:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535945.555713:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535945.558142:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788535945.558154:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:3.0:1788535945.558175:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a9bf768a80, transno 4294967307 00000004:00080000:3.0:1788535945.558231:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1788535945.558269:0:3311:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff97a9b9231180 x1875415607093120/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788535961 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788535945.558283:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a9b9231180/2, rc 0, transno 4294967310 00000004:00080000:0.0:1788535945.558358:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a9bf769500/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788535945.558364:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607093248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788535945.562324:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9231180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607093120:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788535945.609560:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1788535945.609577:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:1.0:1788535945.609583:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1788535945.609592:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1788535945.609748:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+7:2356:x1875415589286144:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 56123us (57687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535945.609759:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1788535945.615023:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535945.615229:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589286528 00000100:00100000:0.0:1788535945.615240:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589286528 00000100:00100000:0.0:1788535945.615296:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 228 00000100:00100000:0.0:1788535945.615307:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+20:11606:x1875415589286528:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788535945.615359:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535945.615407:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca200/0x74f51638375d48a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159cb expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.615427:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a997503c00) 00010000:00010000:0.0:1788535945.615433:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788535945.615472:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d48c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.615499:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d48c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.615509:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d48c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535945.615769:0:5832:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000003170f000 reply state 0000000079bde7a4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d48c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535945.615779:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788535945.615871:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30a1922d-0d3f-4681-a966-cec3672631c6+21:11606:x1875415589286528:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 565us (856us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788535945.615878:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 228 00010000:00010000:3.0:1788535945.619363:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d48c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.619392:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d48c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.619410:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d48c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.619417:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535945.619422:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d48c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.619430:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d48c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.619447:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a997503c00) 00010000:00010000:3.0:1788535945.619450:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535945.619455:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d48c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.619462:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca800/0x74f51638375d48c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535945.621878:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535945.621950:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589286656 00000100:00100000:2.0:1788535945.621960:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589286656 00000100:00100000:2.0:1788535945.622016:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:2.0:1788535945.622027:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2356:x1875415589286656:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788535945.622274:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788535945.622278:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788535945 -> 1788535944 00002000:00010000:2.0:1788535945.622281:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788535944 00002000:00010000:2.0:1788535945.622283:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788535945 -> 1788535944 00002000:00010000:2.0:1788535945.622285:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788535945.622344:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:2356:x1875415589286656:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 319us (480us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788535945.622351:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:1.0:1788535945.625705:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535945.625855:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589286912 00000100:00100000:2.0:1788535945.625864:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589286912 00000100:00100000:2.0:1788535945.626003:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:2.0:1788535945.626014:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+20:11606:x1875415589286912:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788535945.626097:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.626114:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4889 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159bd expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.626125:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.626157:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4889 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159bd expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.626177:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4889 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159bd expref: 20 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535945.626191:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607093632:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788535945.626281:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fe780 going to sleep for 11 seconds 00000100:00100000:2.0:1788535945.629269:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607093632:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535945.629298:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535945.630130:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535945.630210:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589287040 00000100:00100000:2.0:1788535945.630219:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589287040 00010000:00010000:2.0:1788535945.630257:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4889 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159bd expref: 21 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535945.630336:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:2.0:1788535945.630347:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+21:2355:x1875415589287040:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535945.630388:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535945.630408:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4889 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159bd expref: 21 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.630422:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4889 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159bd expref: 21 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.630446:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4889 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159bd expref: 21 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.630464:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a997503c00) 00010000:00010000:2.0:1788535945.630468:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.630479:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.630486:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.630520:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535945.630621:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+20:2355:x1875415589287040:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 276us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535945.630629:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00010000:00010000:3.0:1788535945.630650:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.630665:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.630704:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.630712:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.630718:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.630731:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788535945.630735:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.630743:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.630752:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a997503c00) 00010000:00010000:3.0:1788535945.630755:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788535945.630758:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535945.630763:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d48cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535945.630804:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+19:11606:x1875415589286912:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 4792us (5107us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788535945.630812:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:1.0:1788535945.634552:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535945.636081:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589287168 00000100:00100000:0.0:1788535945.636095:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589287168 00000100:00100000:0.0:1788535945.636200:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:0.0:1788535945.636212:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589287168:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788535945.636256:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.636276:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d48b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d9 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.636285:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535945.636289:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788535945.636295:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.636350:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d48b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d9 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.636365:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d48b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d9 expref: 8 pid: 8424 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535945.636457:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1875415607093760:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535945.636613:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a997579300 going to sleep for 11 seconds 00000100:00100000:0.0:1788535945.656232:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535945.656296:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589287296 00000100:00100000:1.0:1788535945.656306:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589287296 00010000:00010000:1.0:1788535945.656357:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d48b3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d9 expref: 9 pid: 8424 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535945.656418:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:1.0:1788535945.656428:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+9:2355:x1875415589287296:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535945.656443:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535945.656467:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d48b3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d9 expref: 9 pid: 8424 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.656482:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d48b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d9 expref: 9 pid: 8424 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.656507:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535945.656513:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535945.656519:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.656533:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.656563:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535945.656579:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d48b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159d9 expref: 9 pid: 8424 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535945.656594:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1875415607093760:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788535945.656616:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589287296:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 189us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535945.656628:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00010000:00010000:2.0:1788535945.656644:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.656655:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.656662:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.656689:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.656698:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.656706:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.656712:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca600 already unused, calling callback (ffffffffc1455530) 00010000:00010000:2.0:1788535945.656716:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.656732:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.656744:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.656758:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001931c2b5/0x74f51638375d48d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535945.656805:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30a1922d-0d3f-4681-a966-cec3672631c6+7:2355:x1875415589287168:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 20596us (22262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535945.656812:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:2.0:1788535945.663644:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535945.663814:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589287552 00000100:00100000:1.0:1788535945.663824:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589287552 00000100:00100000:1.0:1788535945.663883:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 230 00000100:00100000:1.0:1788535945.663930:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+19:11606:x1875415589287552:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788535945.665465:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d48dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.665486:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d48dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.665499:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d48dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.665744:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.665759:0:11644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4897 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159c4 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.665768:0:11644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.665803:0:11644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4897 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159c4 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.665825:0:11644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4897 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159c4 expref: 20 pid: 5834 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535945.665841:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607093888:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788535945.666073:0:11644:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a997579000 going to sleep for 11 seconds 00000100:00100000:2.0:1788535945.668479:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607093888:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535945.668516:0:11644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535945.671534:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535945.671675:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589287680 00000100:00100000:1.0:1788535945.671684:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589287680 00010000:00010000:1.0:1788535945.671720:0:7598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4897 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159c4 expref: 21 pid: 5834 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535945.671913:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:1.0:1788535945.671924:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+21:2355:x1875415589287680:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535945.671939:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535945.671947:0:7598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4897 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159c4 expref: 21 pid: 5834 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.671961:0:7598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4897 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159c4 expref: 21 pid: 5834 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.671983:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4897 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159c4 expref: 21 pid: 5834 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.671999:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a997503c00) 00010000:00010000:1.0:1788535945.672005:0:7598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.672032:0:7598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.672040:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.672071:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535945.672118:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30a1922d-0d3f-4681-a966-cec3672631c6+20:2355:x1875415589287680:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 196us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535945.672125:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00010000:00010000:2.0:1788535945.672246:0:11644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.672255:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535945.672450:0:11644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788535945.672606:0:11644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788535945.672654:0:11644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788535945.672857:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11644:1875415607094016:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788535945.673078:0:11644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535945.673111:0:11644:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99114a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788535945.673394:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607094016 00000100:00100000:3.0:1788535945.673411:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607094016 00000100:00100000:3.0:1788535945.673452:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788535945.673475:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11644:x1875415607094016:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788535945.673555:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11644:x1875415607094016:12345-0@lo:1000:mdt00_004.0 Request processed in 80us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535945.673562:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788535945.673868:0:11644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788535945.673875:0:11644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1788535945.673925:0:11644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a9b61ad180, transno 4294967321 00000004:00080000:2.0:1788535945.673936:0:11644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a9bf769500, transno 4294967322 00000100:00100000:2.0:1788535945.673969:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11644:1875415607094016:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788535945.674528:0:11644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788535945.674588:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11644:1875415607094144:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788535945.674635:0:11644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535945.674654:0:11644:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fe780 going to sleep for 11 seconds 00000100:00100000:3.0:1788535945.675103:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607094144 00000100:00100000:3.0:1788535945.675111:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607094144 00000100:00100000:1.0:1788535945.675176:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788535945.675187:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11644:x1875415607094144:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788535945.675366:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11644:x1875415607094144:12345-0@lo:1000:mdt00_004.0 Request processed in 181us (729us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788535945.675373:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788535945.675445:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11644:1875415607094144:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788535945.675483:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675493:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675501:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675506:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535945.675511:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675518:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675533:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a997503c00) 00010000:00010000:2.0:1788535945.675536:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788535945.675541:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675547:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d48e4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675574:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4827 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675589:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4827 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675595:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4827 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675600:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0be00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535945.675603:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4827 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675610:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4827 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675619:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:2.0:1788535945.675622:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788535945.675627:0:11644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d482e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a8 expref: 23 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675638:0:11644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d482e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a8 expref: 23 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675647:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d482e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a8 expref: 23 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.675674:0:11644:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d482e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a8 expref: 23 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535945.675685:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b735c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607094272:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788535945.675872:0:11644:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fe780 going to sleep for 11 seconds 00000100:00100000:0.0:1788535945.684931:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535945.684972:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589287808 00000100:00100000:1.0:1788535945.684982:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589287808 00000100:00100000:1.0:1788535945.685040:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1788535945.685049:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+24:11605:x1875415589287808:12345-192.168.203.12@tcp:49:lfs.0 00000100:00100000:2.0:1788535945.685174:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b735c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11644:1875415607094272:192.168.203.12@tcp:105: 00000100:00100000:1.0:1788535945.685175:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+24:11605:x1875415589287808:12345-192.168.203.12@tcp:49:lfs.0 Request processed in 128us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535945.685182:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00010000:00010000:2.0:1788535945.685202:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4827 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685212:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0be00/0x74f51638375d4827 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685247:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d48eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685261:0:11644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d48eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685273:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d48eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685283:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d48eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685289:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d48eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685296:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d48eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685301:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50c00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535945.685305:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d48eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685311:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d48eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685337:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:2.0:1788535945.685340:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535945.685344:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d48eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685350:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d48eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685360:0:11644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d48dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685366:0:11644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d48dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685371:0:11644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d48dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685376:0:11644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecbe00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535945.685378:0:11644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d48dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685410:0:11644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d48dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685418:0:11644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:2.0:1788535945.685420:0:11644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788535945.685424:0:11644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d48dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.685429:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbe00/0x74f51638375d48dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535945.685625:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+23:11606:x1875415589287552:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 21696us (21989us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788535945.685633:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 230 00000020:00080000:2.0:1788535945.685637:0:11644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788535945.685703:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535945.685707:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535945.686208:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788535945.686216:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788535945.688431:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535945.688789:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589288064 00000100:00100000:2.0:1788535945.688799:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589288064 00000100:00100000:2.0:1788535945.688855:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:2.0:1788535945.688865:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+23:11605:x1875415589288064:12345-192.168.203.12@tcp:58:lfs.0 00000040:00080000:2.0:1788535945.689250:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788535945.689330:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+23:11605:x1875415589288064:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 464us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535945.689338:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:3.0:1788535945.690934:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535945.691231:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589288320 00000100:00100000:1.0:1788535945.691240:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589288320 00000100:00100000:1.0:1788535945.691295:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:1.0:1788535945.691305:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99c78ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+23:11606:x1875415589288320:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788535945.695452:0:5835:0:(mdd_object.c:4338:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788535945.696334:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1788535945.696422:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d48f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.696438:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d48f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.696450:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d48f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.696458:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d48f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.696465:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d48f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.696471:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d48f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535945.696495:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788535945.696606:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99c78ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+25:11606:x1875415589288320:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 5298us (5721us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788535945.696615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000020:00080000:1.0:1788535945.696620:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788535945.696962:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535945.696970:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d48f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.696977:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ae00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:2.0:1788535945.696982:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d48f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.696990:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d48f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.697002:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97a9888ad200) 00010000:00010000:2.0:1788535945.697006:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788535945.697011:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d48f2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.697032:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ae00/0x74f51638375d48f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.697051:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535945.697052:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535945.697054:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535945.728117:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535945.728266:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589288448 00000100:00100000:2.0:1788535945.728277:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589288448 00000100:00100000:2.0:1788535945.728338:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 232 00000100:00100000:2.0:1788535945.728348:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+25:11608:x1875415589288448:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788535945.728374:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535945.728404:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d48f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159e0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.728472:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4900 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.728489:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4900 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.728500:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4900 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.728514:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50800/0x74f51638375d4907 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.728520:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50800/0x74f51638375d4907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.728527:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50800/0x74f51638375d4907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.728771:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d490e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.728783:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a1 expref: 26 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.728793:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d490e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.728824:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a1 expref: 26 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.728838:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a1 expref: 26 pid: 11644 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535945.728851:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b735c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607094400:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788535945.728974:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99803ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535945.733369:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535945.733464:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589288704 00000100:00100000:0.0:1788535945.733474:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589288704 00000100:00100000:0.0:1788535945.733533:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1788535945.733552:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+27:5593:x1875415589288704:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788535945.733800:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+28:5593:x1875415589288704:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 249us (438us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788535945.733808:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1788535945.735328:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b735c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875415607094400:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788535945.735356:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d490e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535945.737046:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535945.737181:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589288832 00000100:00100000:0.0:1788535945.737191:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589288832 00010000:00010000:0.0:1788535945.737228:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a1 expref: 28 pid: 11644 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535945.737270:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:0.0:1788535945.737278:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987b98850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+28:2355:x1875415589288832:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535945.737302:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535945.737308:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a1 expref: 28 pid: 11644 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.737319:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a1 expref: 28 pid: 11644 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.737339:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4819 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a1 expref: 28 pid: 11644 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.737355:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:0.0:1788535945.737359:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d490e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.737368:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d490e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.737374:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d490e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535945.737406:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535945.737452:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987b98850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a1922d-0d3f-4681-a966-cec3672631c6+27:2355:x1875415589288832:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 174us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535945.737459:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00010000:00010000:2.0:1788535945.738013:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d490e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738023:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d490e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535945.738080:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788535945.738093:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788535945.738117:0:5834:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d490e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738131:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d490e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738140:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4900 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738146:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4900 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738153:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4900 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738159:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50a00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535945.738164:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4900 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738172:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4900 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738183:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:2.0:1788535945.738187:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535945.738190:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4900 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738196:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50a00/0x74f51638375d4900 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738207:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50800/0x74f51638375d4907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738223:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50800/0x74f51638375d4907 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738229:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50800/0x74f51638375d4907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738234:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788535945.738237:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50800/0x74f51638375d4907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738243:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50800/0x74f51638375d4907 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738251:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97a99742a800) 00010000:00010000:2.0:1788535945.738253:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535945.738256:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50800/0x74f51638375d4907 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738273:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50800/0x74f51638375d4907 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738310:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50c00/0x74f51638375d48f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159e0 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738323:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d490e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159e0 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535945.738330:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:2.0:1788535945.738333:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535945.738340:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc50400, rc 0) 00000100:00100000:2.0:1788535945.738375:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+26:11608:x1875415589288448:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 10029us (10268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535945.738382:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 232 00010000:00010000:3.0:1788535946.125326:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788535946.603179:0:12467:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535946.603189:0:12467:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788535946.603237:0:12467:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788535946.603242:0:12467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788535946.702374:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788535946.702384:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788535946.702452:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788535946.702459:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788535946.702602:0:11640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b735c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11640:1875415607094528:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788535946.702697:0:11640:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fe000 going to sleep for 11 seconds 00000100:00100000:0.0:1788535946.714060:0:11640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b735c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11640:1875415607094528:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788535946.715017:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535946.715679:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589288960 00000100:00100000:0.0:1788535946.715689:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589288960 00000100:00100000:0.0:1788535946.715763:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00100000:0.0:1788535946.715783:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+26:11620:x1875415589288960:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788535946.715819:0:11644:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788535946.715997:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+26:11620:x1875415589288960:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 156us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535946.716004:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00080000:2.0:1788535946.716156:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535946.719772:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535946.719844:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589289216 00000100:00100000:3.0:1788535946.719854:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589289216 00000100:00100000:3.0:1788535946.719956:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:3.0:1788535946.719967:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+26:11620:x1875415589289216:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535946.719989:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535946.720009:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d4915 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159e7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535946.720109:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d491c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535946.720139:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d491c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535946.720153:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d491c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535946.720166:0:6697:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788535946.720306:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d4915 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159e7 expref: 29 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535946.720326:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d491c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159e7 expref: 28 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535946.720334:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:3.0:1788535946.720337:0:6697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535946.720341:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980031000, rc 0) 00000100:00100000:3.0:1788535946.720415:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+28:11620:x1875415589289216:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 450us (653us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788535946.720422:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:0.0:1788535946.726780:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535946.727435:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589289344 00000100:00100000:2.0:1788535946.727446:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589289344 00000100:00100000:2.0:1788535946.727522:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788535946.727532:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+28:2356:x1875415589289344:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535946.727545:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535946.727579:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d491c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159e7 expref: 28 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535946.727596:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:2.0:1788535946.727601:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535946.727654:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a1922d-0d3f-4681-a966-cec3672631c6+27:2356:x1875415589289344:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 124us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535946.727661:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1788535946.732849:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535946.733036:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589289600 00000100:00100000:0.0:1788535946.733046:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589289600 00000100:00100000:0.0:1788535946.733105:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 235 00000100:00100000:0.0:1788535946.733115:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+27:11620:x1875415589289600:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788535946.733192:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d492a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535946.733208:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d492a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535946.733221:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d492a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535946.733418:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d492a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535946.733426:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d492a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535946.733433:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d492a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535946.733438:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535946.733451:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d492a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535946.733682:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d492a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535946.733695:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:0.0:1788535946.733698:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788535946.733703:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d492a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535946.733709:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987eca400/0x74f51638375d492a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535946.734083:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+28:11620:x1875415589289600:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 967us (1241us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788535946.734093:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 235 00000040:00080000:3.0:1788535946.736173:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535946.736182:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788535946.737201:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788535946.737212:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788535946.737372:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535946.737665:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589289856 00000100:00100000:3.0:1788535946.737675:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589289856 00000100:00100000:3.0:1788535946.737732:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1788535946.737742:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+28:11620:x1875415589289856:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788535946.738223:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+29:11620:x1875415589289856:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 480us (853us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788535946.738231:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1788535947.021221:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9ba2c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607094912:0@lo:400:kworker.0 00000100:00100000:3.0:1788535947.021300:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535947.021364:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535947.021370:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9ba2c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607095040:0@lo:400:kworker.0 00000100:00100000:3.0:1788535947.021404:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535947.021438:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607094912 00000100:00100000:3.0:1788535947.021445:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607094912 00000100:00100000:1.0:1788535947.021456:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607094656:0@lo:400:kworker.0 00000100:00100000:1.0:1788535947.021491:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535947.021497:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788535947.021506:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607094912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535947.021513:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9ba2c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607095168:0@lo:400:kworker.0 00000100:00100000:1.0:1788535947.021532:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535947.021552:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607094912:12345-0@lo:400:kworker.0 Request processed in 47us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535947.021559:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788535947.021560:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788535947.021565:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607094784:0@lo:400:kworker.0 00000100:00100000:3.0:1788535947.021575:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607095168 00000100:00100000:3.0:1788535947.021578:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607095168 00000100:00100000:1.0:1788535947.021585:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535947.021597:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607094784 00000100:00100000:3.0:1788535947.021599:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607094784 00000100:00100000:1.0:1788535947.021600:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9ba2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607095296:0@lo:400:kworker.0 00000100:00100000:3.0:1788535947.021611:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788535947.021617:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607095168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535947.021618:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535947.021641:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607094656 00000100:00100000:1.0:1788535947.021644:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607094656 00000100:00100000:3.0:1788535947.021646:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607095168:12345-0@lo:400:kworker.0 Request processed in 29us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535947.021651:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788535947.021662:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788535947.021670:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788535947.021676:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607094656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535947.021705:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607094656:12345-0@lo:400:kworker.0 Request processed in 29us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535947.021711:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788535947.021754:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607094656:0@lo:400:kworker.0 00000100:00100000:1.0:1788535947.021768:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9ba2c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607095168:0@lo:400:kworker.0 00000100:00080000:1.0:1788535947.021805:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535947.022016:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607095040 00000100:00100000:0.0:1788535947.022021:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607095040 00000100:00100000:0.0:1788535947.022052:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607095296 00000100:00100000:0.0:1788535947.022055:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607095296 00000100:00100000:0.0:1788535947.022071:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788535947.022077:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875415607095040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.022110:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875415607095040:12345-0@lo:400:kworker.0 Request processed in 33us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535947.022116:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788535947.022127:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788535947.022132:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875415607095296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.022159:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875415607095296:12345-0@lo:400:kworker.0 Request processed in 27us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535947.022173:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788535947.022195:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535947.022197:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535947.022215:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9ba2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607095296:0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.022247:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9ba2c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607095040:0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.022256:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9ba2c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607094912:0@lo:400:kworker.0 00000100:00100000:3.0:1788535947.023776:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607094784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535947.023867:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607094784:12345-0@lo:400:kworker.0 Request processed in 2200us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535947.023876:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788535947.026017:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607094784:0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.123418:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535947.123468:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535947.123505:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535947.123539:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535947.123568:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535947.123595:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589290368 00000100:00100000:0.0:1788535947.123603:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589290368 00000100:00100000:0.0:1788535947.123654:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589290240 00000100:00100000:0.0:1788535947.123658:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589290240 00000100:00100000:3.0:1788535947.123763:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589289984 00000100:00100000:3.0:1788535947.123768:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589289984 00000100:00100000:3.0:1788535947.123798:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 288 00000100:00100000:3.0:1788535947.123808:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2358:x1875415589289984:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535947.123917:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2358:x1875415589289984:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 109us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535947.123924:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 288 00000100:00100000:3.0:1788535947.123978:0:12429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:3.0:1788535947.123986:0:12429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:30a1922d-0d3f-4681-a966-cec3672631c6+7:2358:x1875415589290368:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535947.124013:0:12429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:30a1922d-0d3f-4681-a966-cec3672631c6+7:2358:x1875415589290368:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535947.124019:0:12429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00080000:3.0:1788535947.124038:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535947.124041:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788535947.124473:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:0.0:1788535947.124480:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589290240:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535947.124512:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589290240:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535947.124518:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1788535947.126192:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589290112 00000100:00100000:1.0:1788535947.126208:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589290112 00000100:00100000:1.0:1788535947.126249:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589290496 00000100:00100000:1.0:1788535947.126252:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589290496 00000100:00100000:1.0:1788535947.126300:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:1.0:1788535947.126308:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+29:2358:x1875415589290112:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535947.126378:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+29:2358:x1875415589290112:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 72us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535947.126396:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:1.0:1788535947.126412:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:1.0:1788535947.126417:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589290496:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535947.126455:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589290496:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (2887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535947.126461:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00080000:2.0:1788535947.126831:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788535947.149122:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535947.533678:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788535947.533700:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607095424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535947.533762:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535947.533884:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607095424 00000100:00100000:3.0:1788535947.533907:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607095424 00000100:00100000:3.0:1788535947.533954:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788535947.533965:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875415607095424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788535947.533997:0:10342:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788535947.534045:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875415607095424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535947.534053:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788535947.534194:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607095424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788535948.174280:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788535948.471016:0:12518:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535948.471025:0:12518:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788535948.471070:0:12518:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788535948.471075:0:12518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788535948.558428:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607095552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535948.558502:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535948.558764:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607095552 00000100:00100000:1.0:1788535948.558773:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607095552 00000100:00100000:1.0:1788535948.558825:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788535948.558836:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875415607095552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535948.558882:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535948.558973:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875415607095552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535948.558980:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788535948.559170:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607095552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535948.631496:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535948.631564:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589290752 00000100:00100000:0.0:1788535948.631575:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589290752 00000100:00100000:0.0:1788535948.631659:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00100000:0.0:1788535948.631681:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b930b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+29:11641:x1875415589290752:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788535948.631711:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535948.631733:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4931 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159ee expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.631829:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4938 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.631854:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4938 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.631865:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4938 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535948.631875:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788535948.632020:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb600/0x74f51638375d4931 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159ee expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.632037:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4938 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159ee expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.632047:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:0.0:1788535948.632050:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788535948.632054:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecba00, rc 0) 00000100:00100000:0.0:1788535948.632111:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b930b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30a1922d-0d3f-4681-a966-cec3672631c6+31:11641:x1875415589290752:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 432us (623us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788535948.632118:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00080000:3.0:1788535948.636548:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535948.639173:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535948.639246:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589290880 00000100:00100000:0.0:1788535948.639256:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589290880 00000100:00100000:0.0:1788535948.639327:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:0.0:1788535948.639337:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+31:11641:x1875415589290880:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788535948.639415:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4946 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.639432:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.639444:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.639472:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.639479:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4946 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.639486:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4946 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.639491:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788535948.639496:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4946 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.639503:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4946 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.639514:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:0.0:1788535948.639517:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788535948.639521:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4946 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535948.639539:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecb800/0x74f51638375d4946 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535948.639619:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+31:11641:x1875415589290880:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 283us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535948.639627:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:0.0:1788535948.763647:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535948.767672:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589291008 00000100:00100000:1.0:1788535948.767688:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589291008 00000100:00100000:1.0:1788535948.767771:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:1.0:1788535948.767782:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+7:2355:x1875415589291008:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:1.0:1788535948.767799:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535948.767821:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb4214f4/0x74f51638375d494d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159f5 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788535948.767848:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ae488, atime: 0x6a9ae488, ctime: 0x6a9ae488, blocks: 0xb 00010000:00010000:1.0:1788535948.767882:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1788535948.767925:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535948.767936:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4214f4/0x74f51638375d494d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159f5 expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535948.767955:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb4214f4/0x74f51638375d494d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159f5 expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535948.767969:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0ac00, rc 0) 00000100:00100000:1.0:1788535948.768031:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+8:2355:x1875415589291008:12345-192.168.203.12@tcp:101:cat.0 Request processed in 250us (4396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535948.768037:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1788535948.772407:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535948.772635:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589291136 00000100:00100000:2.0:1788535948.772646:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589291136 00002000:00100000:2.0:1788535948.772698:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff97a9b7055f80 x1875415589291136/t0(0) o3->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:604/0 lens 488/0 e 0 to 0 dl 1788535959 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788535948.772709:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b7055f80 with x1875415589291136 ext(0->4095) 00002000:00010000:2.0:1788535948.772714:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a9b7055f80 00000100:00100000:2.0:1788535948.772751:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788535948.772760:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:2356:x1875415589291136:12345-192.168.203.12@tcp:3:cat.0 00000100:00100000:2.0:1788535948.772998:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:30a1922d-0d3f-4681-a966-cec3672631c6+8:2356:x1875415589291136:12345-192.168.203.12@tcp:3:cat.0 Request processed in 238us (600us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788535948.773006:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00002000:00100000:2.0:1788535948.773013:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff97a9b7055f80 x1875415589291136/t0(0) o3->30a1922d-0d3f-4681-a966-cec3672631c6@192.168.203.12@tcp:604/0 lens 488/4536 e 0 to 0 dl 1788535959 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788535948.773021:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a9b7055f80 with x1875415589291136 ext(0->4095) 00002000:00010000:2.0:1788535948.773024:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a9b7055f80 00010000:00010000:3.0:1788535949.197298:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788535950.164470:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:3.0:1788535950.221112:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788535950.656464:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788535950.656486:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788535950.656509:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a99114a900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788535950.656514:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9861c9500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a99114a780 00000020:00080000:0.0:1788535950.656518:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a9861c9e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a9b73ac400 00000020:00080000:0.0:1788535950.656537:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788535950.661500:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1788535950.666263:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1788535950.666279:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:3.0:1788535951.245107:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535952.141321:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607095936:0@lo:400:kworker.0 00000100:00100000:0.0:1788535952.141403:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535952.141465:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535952.141472:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607096064:0@lo:400:kworker.0 00000100:00100000:0.0:1788535952.141499:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535952.141528:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607095936 00000100:00100000:0.0:1788535952.141534:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607095936 00000100:00100000:0.0:1788535952.141582:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788535952.141591:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607095936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535952.141639:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607095936:12345-0@lo:400:kworker.0 Request processed in 50us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535952.141662:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788535952.141685:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607096064 00000100:00100000:0.0:1788535952.141688:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607096064 00000100:00100000:0.0:1788535952.141714:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788535952.141720:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607096064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535952.141762:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607096064:12345-0@lo:400:kworker.0 Request processed in 43us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535952.141769:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788535952.141810:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788535952.141815:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a9b9231180, transno 4294967310 00000100:00100000:0.0:1788535952.142036:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607096064:0@lo:400:kworker.0 00000100:00100000:0.0:1788535952.142053:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607095936:0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.142144:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607095808:0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.142181:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535952.142208:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a983669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607096320:0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.142243:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535952.142269:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788535952.142275:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607095680:0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.142301:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535952.142320:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607096192:0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.142341:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788535952.142377:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535952.142381:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535952.142390:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607096320 00000100:00100000:3.0:1788535952.142394:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607096320 00000100:00100000:3.0:1788535952.142422:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788535952.142428:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607096320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.142461:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607096320:12345-0@lo:400:kworker.0 Request processed in 34us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535952.142467:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788535952.142492:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607095808 00000100:00100000:3.0:1788535952.142496:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607095808 00000100:00100000:3.0:1788535952.142511:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607096192 00000100:00100000:3.0:1788535952.142514:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607096192 00000100:00100000:3.0:1788535952.142531:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788535952.142536:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607095808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.142566:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607095808:12345-0@lo:400:kworker.0 Request processed in 29us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535952.142572:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788535952.142582:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788535952.142587:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607096192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.142612:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607096192:12345-0@lo:400:kworker.0 Request processed in 25us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535952.142618:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1788535952.142630:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788535952.142633:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535952.142653:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607096192:0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.142662:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607095808:0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.142669:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788535952.142673:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1788535952.142688:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a983669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607096320:0@lo:400:kworker.0 00000100:00100000:1.0:1788535952.143314:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607095680 00000100:00100000:1.0:1788535952.143322:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607095680 00000100:00100000:1.0:1788535952.143362:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788535952.143370:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3311:x1875415607095680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535952.143427:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3311:x1875415607095680:12345-0@lo:400:kworker.0 Request processed in 58us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535952.143434:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788535952.144340:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607095680:0@lo:400:kworker.0 00000100:00100000:1.0:1788535952.265496:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535952.265545:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535952.265586:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535952.265609:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535952.265631:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535952.265675:0:12429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589291520 00000100:00100000:1.0:1788535952.265684:0:12429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589291520 00000100:00100000:1.0:1788535952.265738:0:12429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589291648 00000100:00100000:1.0:1788535952.265752:0:12429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589291648 00000100:00100000:1.0:1788535952.265775:0:12429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:1.0:1788535952.265786:0:12429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589291520:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535952.265857:0:12429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:30a1922d-0d3f-4681-a966-cec3672631c6+5:2358:x1875415589291520:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 73us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535952.265864:0:12429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:1.0:1788535952.265882:0:12429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:1.0:1788535952.265912:0:12429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:30a1922d-0d3f-4681-a966-cec3672631c6+7:2358:x1875415589291648:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535952.265938:0:12429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:30a1922d-0d3f-4681-a966-cec3672631c6+7:2358:x1875415589291648:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535952.265945:0:12429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:1.0:1788535952.265963:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589291776 00000100:00100000:1.0:1788535952.265966:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589291776 00000100:00100000:1.0:1788535952.265993:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589291392 00000100:00100000:1.0:1788535952.265997:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589291392 00000100:00100000:1.0:1788535952.266015:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:1.0:1788535952.266021:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589291776:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535952.266049:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2358:x1875415589291776:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535952.266055:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:1.0:1788535952.266066:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:1.0:1788535952.266072:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+18:2358:x1875415589291392:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788535952.266094:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30a1922d-0d3f-4681-a966-cec3672631c6+18:2358:x1875415589291392:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535952.266106:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:3.0:1788535952.266879:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589291264 00000100:00100000:3.0:1788535952.266911:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589291264 00000100:00100000:3.0:1788535952.266942:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 290 00000100:00100000:3.0:1788535952.266949:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2358:x1875415589291264:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788535952.266987:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2358:x1875415589291264:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535952.267000:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 290 00000100:00080000:3.0:1788535952.267027:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788535952.267032:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535952.267034:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788535952.273748:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535952.660194:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9ba2c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607096448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535952.660274:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535952.660367:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607096448 00000100:00100000:0.0:1788535952.660374:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607096448 00000100:00100000:0.0:1788535952.660419:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788535952.660427:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607096448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535952.660459:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535952.660500:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607096448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535952.660507:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788535952.660621:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9ba2c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607096448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535953.252453:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535953.252535:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589291904 00000100:00100000:2.0:1788535953.252545:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589291904 00000100:00100000:2.0:1788535953.252615:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00100000:2.0:1788535953.252627:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+18:11294:x1875415589291904:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788535953.252733:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+18:11294:x1875415589291904:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 108us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535953.252754:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00100000:3.0:1788535953.254972:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535953.255679:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589292160 00000100:00100000:0.0:1788535953.255708:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589292160 00000100:00100000:0.0:1788535953.255768:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:0.0:1788535953.256304:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+18:11294:x1875415589292160:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788535953.257810:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+19:11294:x1875415589292160:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 2024us (2838us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788535953.257822:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00010000:00010000:3.0:1788535953.293051:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535953.504480:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535953.504577:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589292288 00000100:00100000:3.0:1788535953.504587:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589292288 00000100:00100000:3.0:1788535953.504662:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:3.0:1788535953.504672:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+5:12093:x1875415589292288:12345-192.168.203.12@tcp:101:lsof.0 00010000:00010000:3.0:1788535953.504693:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535953.504714:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4954 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f975159fc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535953.504778:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d495b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535953.504793:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d495b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535953.504804:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d495b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535953.504852:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788535953.504857:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788535953.504882:0:5832:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d495b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535953.504939:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031c00/0x74f51638375d4954 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159fc expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535953.504972:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d495b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159fc expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535953.504980:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ad000) 00010000:00010000:3.0:1788535953.504983:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788535953.504987:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980030600, rc 0) 00000100:00100000:3.0:1788535953.505050:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+6:12093:x1875415589292288:12345-192.168.203.12@tcp:101:lsof.0 Request processed in 380us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535953.505057:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:3.0:1788535953.677599:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535953.677624:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607096576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535953.677697:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535953.677820:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607096576 00000100:00100000:1.0:1788535953.677828:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607096576 00000100:00100000:1.0:1788535953.677880:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788535953.677911:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607096576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535953.677943:0:10342:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535953.677987:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607096576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535953.677994:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788535953.678127:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607096576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788535954.317052:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788535954.962604:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788535954.962614:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788535954.963114:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788535954.963123:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788535955.341835:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788535955.769112:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788535955.769128:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788535955.769181:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788535955.769190:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788535956.371700:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535957.266655:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607096960:0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.266736:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535957.266792:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535957.266799:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607097088:0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.266825:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535957.266862:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607096960 00000100:00100000:1.0:1788535957.266870:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607096960 00000100:00100000:1.0:1788535957.266941:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788535957.266950:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607096960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.267000:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607096960:12345-0@lo:400:kworker.0 Request processed in 51us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535957.267025:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788535957.267049:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607097088 00000100:00100000:1.0:1788535957.267053:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607097088 00000100:00100000:1.0:1788535957.267079:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788535957.267086:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607097088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.267117:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607097088:12345-0@lo:400:kworker.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535957.267124:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1788535957.267139:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788535957.267144:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535957.267179:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607097088:0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.267190:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607096960:0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.267981:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607096704:0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.268033:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535957.268042:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b9230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607096832:0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.268071:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607097216:0@lo:400:kworker.0 00000100:00100000:2.0:1788535957.268084:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535957.268108:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535957.268112:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607097344:0@lo:400:kworker.0 00000100:00100000:2.0:1788535957.268144:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535957.268151:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607096704 00000100:00100000:0.0:1788535957.268157:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607096704 00000100:00100000:2.0:1788535957.268180:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607096832 00000100:00100000:2.0:1788535957.268186:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607096832 00000100:00100000:0.0:1788535957.268202:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788535957.268211:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607096704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535957.268216:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607097216 00000100:00100000:2.0:1788535957.268220:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607097216 00000100:00100000:2.0:1788535957.268251:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788535957.268259:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607096832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.268262:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607096704:12345-0@lo:400:kworker.0 Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.268272:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788535957.268305:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607096832:12345-0@lo:400:kworker.0 Request processed in 47us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.268310:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788535957.268331:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788535957.268335:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607097216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535957.268370:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607096832:0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.268374:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607097216:12345-0@lo:400:kworker.0 Request processed in 41us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.268383:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788535957.268419:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b9231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607096704:0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.268448:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607097216:0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.268707:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607097344 00000100:00100000:1.0:1788535957.268711:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607097344 00000100:00100000:1.0:1788535957.268751:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788535957.268760:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607097344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.268818:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607097344:12345-0@lo:400:kworker.0 Request processed in 59us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535957.268824:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788535957.268844:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535957.268847:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535957.269023:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607097344:0@lo:400:kworker.0 00000001:02000400:1.0:1788535957.307735:0:12722:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 11:32:36 (1788535956) 00000100:00100000:0.0:1788535957.366550:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535957.366605:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535957.366639:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535957.366663:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535957.366688:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535957.366719:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589292672 00000100:00100000:0.0:1788535957.366738:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589292672 00000100:00100000:0.0:1788535957.366991:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589292800 00000100:00100000:0.0:1788535957.366995:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589292800 00000100:00100000:0.0:1788535957.367022:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:0.0:1788535957.367032:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a983669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2357:x1875415589292672:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535957.367513:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a983669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+5:2357:x1875415589292672:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 349us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.367526:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:0.0:1788535957.367546:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:0.0:1788535957.367560:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2357:x1875415589292800:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535957.367663:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30a1922d-0d3f-4681-a966-cec3672631c6+7:2357:x1875415589292800:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 109us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.367670:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:0.0:1788535957.367694:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589292928 00000100:00100000:0.0:1788535957.367698:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589292928 00000100:00100000:0.0:1788535957.367847:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589292544 00000100:00100000:0.0:1788535957.367852:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589292544 00000100:00100000:2.0:1788535957.368257:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589292416 00000100:00100000:2.0:1788535957.368264:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589292416 00000100:00100000:2.0:1788535957.368301:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 292 00000100:00100000:2.0:1788535957.368308:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2357:x1875415589292416:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535957.368355:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2357:x1875415589292416:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 47us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535957.368374:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 292 00000100:00100000:2.0:1788535957.368410:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:2.0:1788535957.368418:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ebecc8-0d84-4b23-8d21-de56113948a9+6:2357:x1875415589292928:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535957.368448:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ebecc8-0d84-4b23-8d21-de56113948a9+6:2357:x1875415589292928:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535957.368455:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:2.0:1788535957.368469:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:2.0:1788535957.368475:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+18:2357:x1875415589292544:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535957.368504:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30a1922d-0d3f-4681-a966-cec3672631c6+18:2357:x1875415589292544:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535957.368510:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00080000:0.0:1788535957.368669:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788535957.369249:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535957.369261:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788535957.392699:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535957.773802:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607097472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535957.773874:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535957.777151:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607097472 00000100:00100000:1.0:1788535957.777166:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607097472 00000100:00100000:1.0:1788535957.777243:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788535957.777254:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607097472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535957.777305:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535957.777399:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607097472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535957.777406:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788535957.777608:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607097472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788535958.415856:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535958.798433:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607097600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535958.798510:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535958.798616:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607097600 00000100:00100000:0.0:1788535958.798624:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607097600 00000100:00100000:0.0:1788535958.798680:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788535958.798692:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a984eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607097600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788535958.798728:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788535958.798787:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a984eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607097600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535958.798794:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788535958.798857:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607097600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788535959.437364:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535960.461211:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535961.224854:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535961.225065:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589293184 00000100:00100000:0.0:1788535961.225076:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589293184 00000100:00100000:0.0:1788535961.225152:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:0.0:1788535961.225163:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+18:12315:x1875415589293184:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:0.0:1788535961.225513:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+19:12315:x1875415589293184:12345-192.168.203.12@tcp:35:umount.0 Request processed in 351us (667us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788535961.225522:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00080000:2.0:1788535961.226202:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535961.229553:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535961.229621:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589293440 00000100:00100000:0.0:1788535961.229630:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589293440 00000100:00100000:0.0:1788535961.229678:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:0.0:1788535961.229686:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+19:12315:x1875415589293440:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:0.0:1788535961.230551:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+20:12315:x1875415589293440:12345-192.168.203.12@tcp:35:umount.0 Request processed in 861us (1002us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788535961.230574:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1788535961.237137:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535961.240702:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589293696 00000100:00100000:0.0:1788535961.240718:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589293696 00000100:00100000:0.0:1788535961.240914:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1788535961.240926:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99c788450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+20:12315:x1875415589293696:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:0.0:1788535961.242087:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99c788450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30a1922d-0d3f-4681-a966-cec3672631c6+21:12315:x1875415589293696:12345-192.168.203.12@tcp:35:umount.0 Request processed in 1156us (4952us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788535961.242099:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:1.0:1788535961.245148:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535961.245387:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589293952 00000100:00100000:3.0:1788535961.245395:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589293952 00000100:00100000:3.0:1788535961.245451:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1788535961.245461:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+21:12315:x1875415589293952:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:3.0:1788535961.246421:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30a1922d-0d3f-4681-a966-cec3672631c6+22:12315:x1875415589293952:12345-192.168.203.12@tcp:35:umount.0 Request processed in 955us (1277us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788535961.246446:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:2.0:1788535961.251616:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535961.251819:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589294080 00000100:00100000:1.0:1788535961.251829:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589294080 00000100:00100000:2.0:1788535961.251960:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535961.252064:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535961.252110:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589294336 00000100:00100000:1.0:1788535961.252115:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589294336 00000100:00100000:1.0:1788535961.252144:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788535961.252153:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b735c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+14:2355:x1875415589294080:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535961.252168:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535961.252188:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980030200/0x74f51638375d39d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515587 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535961.252205:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535961.252265:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b735c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+13:2355:x1875415589294080:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 102us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535961.252273:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788535961.252301:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788535961.252308:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9232300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:2355:x1875415589294336:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535961.252315:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535961.252324:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4b400/0x74f51638375d3939 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751554f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535961.252351:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535961.252369:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9232300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:2355:x1875415589294336:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 61us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535961.252375:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788535961.253492:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589294208 00000100:00100000:2.0:1788535961.253498:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535961.253500:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589294208 00000100:00100000:1.0:1788535961.253534:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788535961.253542:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:2356:x1875415589294208:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535961.253552:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535961.253564:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9b747f200/0x74f51638375d3be7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515652 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535961.253576:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535961.253610:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2356:x1875415589294208:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 68us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535961.253616:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788535961.253681:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589294720 00000100:00100000:3.0:1788535961.253686:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589294720 00000100:00100000:3.0:1788535961.253734:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1788535961.253742:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b9230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+7:2354:x1875415589294720:12345-192.168.203.12@tcp:9:umount.0 00000020:00000080:3.0:1788535961.253764:0:6674:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3f0c 00000020:00010000:3.0:1788535961.253771:0:6674:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97a9bfc93000: total 0 00000100:00080000:3.0:1788535961.253776:0:6674:0:(import.c:65:import_set_state_nolock()) ffff97a9bfc96800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788535961.253809:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:2.0:1788535961.253867:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97a9bfc93000: total 0 00010000:00010000:2.0:1788535961.253920:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a9bfc93000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788535961.253962:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eedb2c92/0x74f51638375d42af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515827 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535961.254010:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb4214f4/0x74f51638375d494d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159f5 expref: 5 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535961.254022:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a9bfc93000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788535961.254033:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535961.254035:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535961.254037:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535961.254108:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b9230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30a1922d-0d3f-4681-a966-cec3672631c6+2:2354:x1875415589294720:12345-192.168.203.12@tcp:9:umount.0 Request processed in 366us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535961.254116:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00080000:1.0:1788535961.254184:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788535961.258928:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535961.259207:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589294848 00000100:00100000:0.0:1788535961.259217:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589294848 00000100:00100000:0.0:1788535961.259305:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00080000:1.0:1788535961.259310:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535961.259317:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b61a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+5:2354:x1875415589294848:12345-192.168.203.12@tcp:9:umount.0 00000020:00000080:0.0:1788535961.259346:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3cab 00000100:00080000:0.0:1788535961.259354:0:8424:0:(import.c:65:import_set_state_nolock()) ffff97a9b6d7d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788535961.259398:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788535961.259648:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b61a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30a1922d-0d3f-4681-a966-cec3672631c6+2:2354:x1875415589294848:12345-192.168.203.12@tcp:9:umount.0 Request processed in 333us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535961.259655:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00010000:00010000:3.0:1788535961.259730:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535961.266666:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535961.266778:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589295872 00000100:00100000:2.0:1788535961.266787:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589295872 00000100:00100000:2.0:1788535961.266852:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 240 00000100:00100000:2.0:1788535961.266862:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+22:2354:x1875415589295872:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:2.0:1788535961.266925:0:11644:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3947 00000020:00010000:2.0:1788535961.266938:0:11644:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97a987b6f000: total 0 00000100:00080000:2.0:1788535961.266943:0:11644:0:(import.c:65:import_set_state_nolock()) ffff97a987b6b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788535961.266962:0:11644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1788535961.267300:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30a1922d-0d3f-4681-a966-cec3672631c6+21:2354:x1875415589295872:12345-192.168.203.12@tcp:39:umount.0 Request processed in 429us (633us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788535961.267309:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 240 00000020:00010000:3.0:1788535961.267413:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97a987b6f000: total 0 00010000:00010000:3.0:1788535961.267456:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a987b6f000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788535961.267487:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:3.0:1788535961.267491:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788535961.267498:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d3f6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751574e expref: 20 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.267513:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a9888ade00) 00010000:00010000:3.0:1788535961.267516:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788535961.267520:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b600/0x74f51638375d3c11 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515660 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.267536:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535961.267538:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788535961.267553:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecae00/0x74f51638375d429a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515820 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.267567:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:3.0:1788535961.267569:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788535961.267573:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a400/0x74f51638375d460c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751591c expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.267584:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97a9888ad800) 00010000:00010000:3.0:1788535961.267586:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788535961.267589:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b000/0x74f51638375d3c81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751567c expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.267602:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:3.0:1788535961.267604:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788535961.267607:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecbc00/0x74f51638375d482e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159a8 expref: 15 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.267618:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97a99742a000) 00010000:00010000:3.0:1788535961.267620:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788535961.267623:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d432d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751584a expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.267636:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535961.267638:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788535961.267641:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e200/0x74f51638375d4190 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975157da expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.267652:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a99742a400) 00010000:00010000:3.0:1788535961.267658:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535961.267663:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fa00/0x74f51638375d3c2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515667 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.267747:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97a9a0685e00) 00010000:00010000:3.0:1788535961.267749:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535961.267753:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4270 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515812 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.267765:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:3.0:1788535961.267767:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535961.267770:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9bfc50400/0x74f51638375d490e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159e0 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.267779:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ad000) 00010000:00010000:3.0:1788535961.267781:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788535961.267784:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a000/0x74f51638375d4311 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515843 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.267792:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97a9a0685300) 00010000:00010000:3.0:1788535961.267794:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788535961.267797:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a987ecba00/0x74f51638375d4938 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159ee expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.267807:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a987b6f000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788535961.267818:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535961.267820:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535961.267822:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535961.487365:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535962.381320:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607097728:0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.381379:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b61ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607097856:0@lo:400:kworker.0 00000100:00100000:3.0:1788535962.381449:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607097984:0@lo:400:kworker.0 00000100:00100000:1.0:1788535962.381563:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607098112:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.381589:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535962.385396:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535962.385476:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607098368:0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.385514:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535962.385569:0:12429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607098368 00000100:00100000:2.0:1788535962.385584:0:12429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607098368 00000100:00100000:2.0:1788535962.385649:0:12429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788535962.385658:0:12429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607098368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.385882:0:12429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607098368:12345-0@lo:400:kworker.0 Request processed in 225us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.385909:0:12429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788535962.386026:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607098368:0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.386074:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607097856 00000100:00100000:2.0:1788535962.386078:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607097856 00000100:00100000:2.0:1788535962.386107:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788535962.386125:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607097856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.386166:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607097856:12345-0@lo:400:kworker.0 Request processed in 42us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.386173:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788535962.386192:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607097728 00000100:00100000:2.0:1788535962.386195:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607097728 00000100:00100000:2.0:1788535962.386219:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788535962.386226:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607097728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.387091:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607097728:12345-0@lo:400:kworker.0 Request processed in 859us (5690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.387101:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788535962.387154:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b61ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607097856:0@lo:400:kworker.0 00000100:00080000:2.0:1788535962.387206:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535962.388301:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535962.388364:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607097984 00000100:00100000:2.0:1788535962.388371:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607097984 00000100:00100000:1.0:1788535962.388465:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535962.389086:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788535962.389097:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607097984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.389179:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607097984:12345-0@lo:400:kworker.0 Request processed in 84us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.389186:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788535962.389218:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607098112 00000100:00100000:2.0:1788535962.389222:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607098112 00000100:00100000:1.0:1788535962.389227:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607097984:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.389318:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607097728:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.389329:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607098240:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.389362:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.389383:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607098240 00000100:00100000:0.0:1788535962.389394:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607098240 00000100:00080000:3.0:1788535962.389497:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535962.389502:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535962.393818:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788535962.393835:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607098112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.393943:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607098112:12345-0@lo:400:kworker.0 Request processed in 114us (5477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.393960:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788535962.394090:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607098112:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.400139:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788535962.400155:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607098240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.400412:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607098240:12345-0@lo:400:kworker.0 Request processed in 262us (11049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535962.400420:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788535962.402011:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607098240:0@lo:400:kworker.0 00000100:00100000:1.0:1788535962.483255:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535962.483313:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535962.483389:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589296000 00000100:00100000:0.0:1788535962.483409:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589296000 00000100:00100000:0.0:1788535962.483467:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 294 00000100:00100000:0.0:1788535962.483477:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2357:x1875415589296000:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788535962.483552:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2357:x1875415589296000:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535962.483623:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 294 00000100:00100000:2.0:1788535962.483709:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589296128 00000100:00100000:2.0:1788535962.483714:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589296128 00000100:00100000:2.0:1788535962.483764:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:2.0:1788535962.483771:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+6:2357:x1875415589296128:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788535962.483802:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ebecc8-0d84-4b23-8d21-de56113948a9+6:2357:x1875415589296128:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.483809:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00080000:3.0:1788535962.483820:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788535962.509615:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535962.883146:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535962.883226:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788535962.892313:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788535962.896005:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589296256 00000100:00100000:3.0:1788535962.896020:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589296256 00000100:00100000:2.0:1788535962.896429:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589296512 00000100:00100000:2.0:1788535962.896435:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589296512 00000100:00100000:2.0:1788535962.896449:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589296384 00000100:00100000:2.0:1788535962.896452:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589296384 00000100:00100000:2.0:1788535962.896471:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1788535962.896490:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+12:2358:x1875415589296256:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535962.896504:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535962.896524:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4ae00/0x74f51638375d3a19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751559c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535962.896557:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535962.896616:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+11:2358:x1875415589296256:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 128us (13547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.896624:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1788535962.896642:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788535962.896649:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7417480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+10:2358:x1875415589296512:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535962.896659:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535962.896669:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d3be0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751564b expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535962.896677:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535962.896695:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7417480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+9:2358:x1875415589296512:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 46us (13469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.896701:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788535962.896713:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1788535962.896720:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a987b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+8:2358:x1875415589296384:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535962.896727:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535962.896736:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9c2051a00/0x74f51638375d3a20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975155c6 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535962.896744:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535962.896761:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a987b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+7:2358:x1875415589296384:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 41us (4459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.896767:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1788535962.896882:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607098496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535962.896972:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535962.897044:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607098496 00000100:00100000:2.0:1788535962.897047:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607098496 00000100:00100000:2.0:1788535962.897077:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788535962.897083:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607098496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535962.899925:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788535962.900034:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607098496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2947us (3058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.900044:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788535962.900309:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607098496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535962.901990:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788535962.902394:0:11644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589296768 00000100:00100000:0.0:1788535962.902414:0:11644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589296768 00000100:00100000:0.0:1788535962.902472:0:11644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:0.0:1788535962.902492:0:11644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ebecc8-0d84-4b23-8d21-de56113948a9+6:2354:x1875415589296768:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:0.0:1788535962.902532:0:11644:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3a2e 00000020:00010000:0.0:1788535962.902546:0:11644:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97a9b6d5a000: total 0 00000100:00080000:0.0:1788535962.902551:0:11644:0:(import.c:65:import_set_state_nolock()) ffff97a9b6d5d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788535962.902575:0:11644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788535962.906237:0:11644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ebecc8-0d84-4b23-8d21-de56113948a9+5:2354:x1875415589296768:12345-192.168.203.12@tcp:39:umount.0 Request processed in 3736us (4245us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788535962.906250:0:11644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 241 00000020:00010000:3.0:1788535962.915125:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97a9b6d5a000: total 0 00010000:00010000:3.0:1788535962.915136:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535962.915194:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a9b6d5a000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788535962.915233:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ad000) 00010000:00010000:3.0:1788535962.915237:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788535962.915249:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030600/0x74f51638375d495b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f975159fc expref: 4 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535962.915288:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a9b6d5a000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788535962.915300:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535962.915302:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535962.915303:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535962.943863:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788535962.944013:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589297024 00000100:00100000:2.0:1788535962.944023:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589297024 00000100:00100000:2.0:1788535962.944079:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 295 00000100:00100000:2.0:1788535962.944089:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+7:2354:x1875415589297024:12345-192.168.203.12@tcp:251:umount.0 00000020:00000080:2.0:1788535962.944134:0:5826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3924 00000020:00010000:2.0:1788535962.944142:0:5826:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97a9b6d58800: total 0 00000100:00080000:2.0:1788535962.944146:0:5826:0:(import.c:65:import_set_state_nolock()) ffff97a9b6d5d000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1788535962.944187:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97a9b6d58800: total 0 00000100:00100000:2.0:1788535962.944221:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f489c5f-831c-44bf-8a5a-dfa0a2f87b19+3:2354:x1875415589297024:12345-192.168.203.12@tcp:251:umount.0 Request processed in 133us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.944232:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 295 00010000:00010000:0.0:1788535962.944249:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a9b6d58800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788535962.944313:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981652200/0x74f51638375d39da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f9751558e expref: 2 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535962.944330:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a9b6d58800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788535962.944341:0:5821:0:(genops.c:885:class_export_put()) final put ffff97a9b6d58800/8f489c5f-831c-44bf-8a5a-dfa0a2f87b19 00010000:00010000:0.0:1788535962.944362:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535962.944365:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535962.944367:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788535962.944759:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9b6d58800/8f489c5f-831c-44bf-8a5a-dfa0a2f87b19 for MGS 00000020:00000080:2.0:1788535962.944799:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9b6d5d000 for MGS 00010000:00010000:3.0:1788535963.535391:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535963.922228:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607098624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535963.922305:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535963.923255:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607098624 00000100:00100000:1.0:1788535963.923265:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607098624 00000100:00100000:1.0:1788535963.923358:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788535963.923369:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607098624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535963.923404:0:10342:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788535963.923451:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607098624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535963.923458:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788535963.923591:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607098624:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788535964.177212:0:11640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535964.177222:0:11640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535964.177625:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788535964.177632:0:11640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788535964.557049:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788535964.756260:0:12918:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788535964.772331:0:12918:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788535964.772385:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.772400:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.772407:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.772414:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.772446:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788535964.772452:0:12918:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788535964.772474:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788535964.772478:0:12918:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788535964.772484:0:12918:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788535964.772505:0:12918:0:(import.c:65:import_set_state_nolock()) ffff97a9b7500800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788535964.772555:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535964.772561:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.772569:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a800 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:0.0:1788535964.772573:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.772582:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535964.772590:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535964.772605:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788535964.772608:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788535964.772610:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788535964.772633:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.772639:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788535964.772681:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607098880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788535964.772791:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.772800:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a800/0x74f51638375d39a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d39b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.772812:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535964.772814:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535964.772816:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535964.772849:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535964.772923:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875415607098752:0@lo:39:umount.0 00000100:00100000:2.0:1788535964.772965:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535964.773008:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607098880 00000100:00100000:0.0:1788535964.773015:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607098880 00000100:00100000:0.0:1788535964.773151:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788535964.773163:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3310:x1875415607098880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788535964.773175:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535964.773189:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980030e00/0x74f51638375d39b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d39a9 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.773201:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535964.773236:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:3310:x1875415607098880:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535964.773291:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788535964.773328:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607098880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535964.773379:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607098752 00000100:00100000:3.0:1788535964.773384:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607098752 00000100:00100000:3.0:1788535964.773414:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788535964.773422:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875415607098752:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788535964.773441:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3733 00000100:00080000:3.0:1788535964.773448:0:5834:0:(import.c:65:import_set_state_nolock()) ffff97a9b6687800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788535964.773500:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3307:x1875415607098752:12345-0@lo:39:umount.0 Request processed in 80us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535964.773507:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788535964.773514:0:5834:0:(genops.c:885:class_export_put()) final put ffff97a9b6686800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788535964.773540:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788535964.773579:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9b6686800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788535964.773626:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9b6687800 for lustre-MDT0000 00000100:00080000:3.0:1788535964.774000:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a9b7500800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788535964.774017:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875415607098752:0@lo:39:umount.0 00000100:00080000:0.0:1788535964.774121:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788535964.774125:0:12918:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788535964.774129:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788535964.778546:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.778565:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.778573:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.778580:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.778600:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788535964.778607:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.778613:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.778619:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.778626:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.778658:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788535964.778665:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.778671:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.778677:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.778684:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.778695:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788535964.778758:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788535964.778765:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.778773:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e800 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535964.778783:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.778793:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535964.778800:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535964.778807:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788535964.778809:0:6687:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788535964.778843:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.778849:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535964.778873:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.778881:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9b747e800/0x74f51638375d39b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d39be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.778908:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788535964.778912:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.778918:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a981652a00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535964.778921:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.778927:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535964.778944:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535964.778949:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788535964.778951:0:6687:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788535964.778953:0:6687:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788535964.778968:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.778974:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535964.778990:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.778997:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a981652a00/0x74f51638375d38de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d38e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.779017:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535964.779020:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.779031:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b200 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535964.779034:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.779041:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535964.779048:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535964.779074:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788535964.779076:0:6687:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788535964.779090:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.779096:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535964.779102:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.779109:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535964.779111:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535964.779112:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535964.779130:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607099008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535964.779191:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535964.779249:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607099264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535964.779288:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535964.779304:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788535964.779315:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607099136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535964.779336:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535964.779363:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607099008 00000100:00100000:3.0:1788535964.779368:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607099008 00000100:00100000:3.0:1788535964.779404:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607099264 00000100:00100000:3.0:1788535964.779407:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607099264 00000100:00100000:3.0:1788535964.779426:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607099136 00000100:00100000:3.0:1788535964.779429:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607099136 00000100:00100000:3.0:1788535964.779444:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788535964.779456:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+20:3311:x1875415607099008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788535964.779467:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535964.779487:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4b000/0x74f51638375d39be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d39b7 expref: 20 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.779499:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535964.779539:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+19:3311:x1875415607099008:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535964.779547:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788535964.779569:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788535964.779575:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+18:3309:x1875415607099264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788535964.779582:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535964.779591:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4aa00/0x74f51638375d3bd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d3bd2 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.779600:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535964.779632:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+17:3309:x1875415607099264:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535964.779638:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788535964.779650:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788535964.779656:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+16:3309:x1875415607099136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788535964.779663:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535964.779671:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9c216da00/0x74f51638375d38e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d38de expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535964.779681:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535964.779701:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:3309:x1875415607099136:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535964.779707:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788535964.779743:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607099136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535964.779762:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea5d41c9-12b3-443f-877d-8b3d703772fc:3309:1875415607099264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535964.779788:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea5d41c9-12b3-443f-877d-8b3d703772fc:3311:1875415607099008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788535964.780125:0:12918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b200/0x74f51638375d3bd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d3bd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535964.780136:0:12918:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788535964.780143:0:12918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216c200/0x74f51638375d3692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.780150:0:12918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216c200/0x74f51638375d3692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.780157:0:12918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c216c200/0x74f51638375d3692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.780164:0:12918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff97a9c216c200/0x74f51638375d3692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535964.780194:0:12918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788535964.780199:0:12918:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788535964.780202:0:12918:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788535964.780238:0:12918:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788535964.780242:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788535964.780246:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535964.780251:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1788535964.780259:0:12918:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff97a9bf151000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788535964.780272:0:12918:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff97a9bf5c7800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788535964.780280:0:12918:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff97a9b6d5a000 71ebecc8-0d84-4b23-8d21-de56113948a9 192.168.203.12@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788535964.780284:0:12918:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff97a987b6f000 30a1922d-0d3f-4681-a966-cec3672631c6 192.168.203.12@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:0.0:1788535964.780289:0:12918:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff97a9b74f4d40) has exports, disconnecting them 00000020:00080000:0.0:1788535964.780294:0:12918:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97a9bf151000), last request at 1788535962 00000020:00000080:0.0:1788535964.780301:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d38a6 00000100:00080000:0.0:1788535964.780316:0:12918:0:(import.c:65:import_set_state_nolock()) ffff97a9bf156000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788535964.780356:0:12918:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a9bf151000): rc 0 00000020:00000080:0.0:1788535964.780358:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a9bf151000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788535964.780367:0:12918:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97a9bf5c7800), last request at 1788535962 00000020:00000080:0.0:1788535964.780370:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d37db 00000100:00080000:0.0:1788535964.780375:0:12918:0:(import.c:65:import_set_state_nolock()) ffff97a9bf5c5000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788535964.780381:0:12918:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a9bf5c7800): rc 0 00000020:00000080:0.0:1788535964.780383:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a9bf5c7800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788535964.780391:0:12918:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb59a418b7ae0 00000100:00080000:0.0:1788535964.780408:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788535964.780411:0:12918:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:2.0:1788535964.780456:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535964.780464:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9c216c200/0x74f51638375d3692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535964.780470:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216c200 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:2.0:1788535964.780473:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9c216c200/0x74f51638375d3692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535964.780481:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9c216c200/0x74f51638375d3692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535964.780488:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9c216c200/0x74f51638375d3692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535964.780502:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788535964.780505:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788535964.780507:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788535964.780528:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9c216c200/0x74f51638375d3692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535964.780534:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535964.780551:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9c216c200/0x74f51638375d3692 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535964.780558:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9c216c200/0x74f51638375d3692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d3699 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535964.780570:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535964.780572:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535964.780573:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535964.780594:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607099392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788535964.780636:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535964.780674:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607099392 00000100:00100000:2.0:1788535964.780679:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607099392 00000100:00100000:2.0:1788535964.780709:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788535964.780716:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b740bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+15:3310:x1875415607099392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535964.780724:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535964.780734:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981652800/0x74f51638375d3699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d3692 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535964.780756:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535964.780782:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b740bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea5d41c9-12b3-443f-877d-8b3d703772fc+14:3310:x1875415607099392:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535964.780788:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788535964.780811:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607099392:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1788535964.780925:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788535964.780989:0:12918:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788535964.781002:0:12918:0:(import.c:65:import_set_state_nolock()) ffff97a987b68800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788535964.781054:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788535964.781172:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788535964.781176:0:12918:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788535964.781184:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788535964.781316:0:12918:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788535964.781331:0:12918:0:(import.c:65:import_set_state_nolock()) ffff97a9bf1ef800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788535964.781372:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff97a9b74f4d40) has no exports 00000020:00000080:3.0:1788535964.781456:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bf151000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788535964.781513:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bf5c7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788535964.781534:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9bf156000 for lustre-MDT0000 00000020:00000080:3.0:1788535964.781539:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9bf5c5000 for lustre-MDT0000 00010000:00010000:3.0:1788535964.781552:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535964.781753:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607099520:0@lo:9:umount.0 00000100:00100000:1.0:1788535964.781792:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535964.781823:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607099648:0@lo:9:umount.0 00000100:00100000:1.0:1788535964.781846:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535964.781908:0:12429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607099520 00000100:00100000:1.0:1788535964.781912:0:12429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607099520 00000100:00100000:1.0:1788535964.781948:0:12429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607099648 00000100:00100000:1.0:1788535964.781950:0:12429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607099648 00000100:00100000:1.0:1788535964.781968:0:12429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788535964.781975:0:12429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875415607099520:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788535964.781995:0:12429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3828 00000100:00080000:1.0:1788535964.782002:0:12429:0:(import.c:65:import_set_state_nolock()) ffff97a987b6c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788535964.782068:0:12429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788535964.782252:0:12429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3307:x1875415607099520:12345-0@lo:9:umount.0 Request processed in 272us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535964.782259:0:12429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788535964.782282:0:12429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788535964.782292:0:12429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875415607099648:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788535964.782302:0:12429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3916 00000100:00080000:1.0:1788535964.782307:0:12429:0:(import.c:65:import_set_state_nolock()) ffff97a9bfc91000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788535964.782323:0:12429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788535964.782416:0:12429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3307:x1875415607099648:12345-0@lo:9:umount.0 Request processed in 127us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535964.782422:0:12429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788535964.782438:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535964.782442:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788535964.782453:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535964.782458:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788535964.782479:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a987b68800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788535964.782488:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788535964.782490:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788535964.782494:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607099520:0@lo:9:umount.0 00000100:00080000:1.0:1788535964.782504:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a9bf1ef800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788535964.782511:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788535964.782512:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788535964.782514:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607099648:0@lo:9:umount.0 00000020:00080000:0.0:1788535964.792417:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff97a9b74f4d40) has no exports 00000020:00000080:0.0:1788535964.835204:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d36ed 00000020:00000080:0.0:1788535964.835218:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a9b74af800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788535964.835408:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788535964.835549:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788535964.835559:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788535964.835563:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff97a990fa19c0) has no exports 00000020:00000080:1.0:1788535964.835962:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d36e6 00000020:00000080:1.0:1788535964.835968:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a9ba1c6000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788535964.836140:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9b74af800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788535964.836495:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9ba1c6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788535964.836537:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788535964.836546:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788535964.836549:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a986a53000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788535964.836552:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff97a986a53000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788535964.836559:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:1.0:1788535965.518795:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 30a1922d-0d3f-4681-a966-cec3672631c6 00000020:00000080:1.0:1788535965.518808:0:6701:0:(genops.c:885:class_export_put()) final put ffff97a9b6d7b000/30a1922d-0d3f-4681-a966-cec3672631c6 00000001:00100000:1.0:1788535965.518831:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788535965.518833:0:6701:0:(genops.c:885:class_export_put()) final put ffff97a987b6b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788535965.518866:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9b6d7b000/30a1922d-0d3f-4681-a966-cec3672631c6 for lustre-OST0000 00000020:00000080:0.0:1788535965.519218:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a987b6b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788535965.519308:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9b6d7d000 for lustre-OST0000 00000020:00000080:1.0:1788535965.519315:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a987b6c000 for lustre-OST0000 00010000:00010000:3.0:1788535965.582281:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788535966.039376:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 71ebecc8-0d84-4b23-8d21-de56113948a9 00000001:00080000:0.0:1788535966.039391:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788535966.039466:0:5854:0:(genops.c:885:class_export_put()) final put ffff97a9b6d5a000/71ebecc8-0d84-4b23-8d21-de56113948a9 00000001:00080000:0.0:1788535966.039488:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00000080:3.0:1788535966.039575:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9b6d5a000/71ebecc8-0d84-4b23-8d21-de56113948a9 for lustre-MDT0000 00000020:00000080:3.0:1788535966.039634:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9b6d5d800 for lustre-MDT0000 00000001:00100000:0.0:1788535966.039809:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 30a1922d-0d3f-4681-a966-cec3672631c6 00000001:00080000:0.0:1788535966.039815:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788535966.039820:0:5854:0:(genops.c:885:class_export_put()) final put ffff97a987b6f000/30a1922d-0d3f-4681-a966-cec3672631c6 00000001:00100000:2.0:1788535966.041006:0:7609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788535966.041014:0:7609:0:(genops.c:885:class_export_put()) final put ffff97a9bfc94800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788535966.043620:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a987b6f000/30a1922d-0d3f-4681-a966-cec3672631c6 for lustre-MDT0000 00000020:00000080:1.0:1788535966.043885:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a987b6b000 for lustre-MDT0000 00000001:00100000:2.0:1788535966.044016:0:7609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 30a1922d-0d3f-4681-a966-cec3672631c6 00000020:00000080:2.0:1788535966.044020:0:7609:0:(genops.c:885:class_export_put()) final put ffff97a9bfc93000/30a1922d-0d3f-4681-a966-cec3672631c6 00000020:00000080:1.0:1788535966.044044:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bfc94800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788535966.044073:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9bfc91000 for lustre-OST0001 00000020:00000080:3.0:1788535966.044346:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bfc93000/30a1922d-0d3f-4681-a966-cec3672631c6 for lustre-OST0001 00000020:00000080:3.0:1788535966.044489:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9bfc96800 for lustre-OST0001 00010000:00010000:1.0:1788535966.605272:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788535966.861170:0:12918:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a986bb3cc0 - data ffff97a9bf9ffbd0/ffff97a9b91dc400 00000020:01000000:1.0:1788535966.861303:0:12918:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a986e57a80 - data ffff97a9ad75f6c0/ffff97a9a7d5d400 00000001:00000004:1.0:1788535966.874143:0:12918:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1788535966.998683:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788535966.998692:0:12918:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788535966.998706:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788535966.998709:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788535967.002853:0:6977:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788535967.002860:0:6977:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788535967.002877:0:6977:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788535967.005171:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788535967.005179:0:12918:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788535967.005195:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788535967.005198:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788535967.005591:0:8004:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788535967.005596:0:8004:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788535967.005607:0:8004:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788535967.073260:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d36b5 00000020:00000080:1.0:1788535967.073271:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a991106800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788535967.073453:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a991106800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788535967.086184:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d36ca 00000020:00000080:1.0:1788535967.086197:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a9b7501000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788535967.086246:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788535967.086273:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788535967.086298:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788535967.086305:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff97a9b74f19c0) has no exports 00000004:01000000:1.0:1788535967.086808:0:12918:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788535967.086817:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3908 00000020:00000080:1.0:1788535967.086821:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a9b6d58000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788535967.091515:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9b7501000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788535967.094092:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788535967.094321:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535967.094337:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788535967.094341:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff97a9b67c8000) has no exports 00000020:00000080:0.0:1788535967.094350:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3901 00000020:00000080:0.0:1788535967.094359:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a9bf1eb800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788535967.095849:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9b6d58000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788535967.100702:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bf1eb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788535967.101404:0:12918:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788535967.101410:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788535967.101414:0:12918:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788535967.101463:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788535967.101466:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788535967.101506:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535967.101516:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788535967.101523:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3821 00000020:00000080:0.0:1788535967.101531:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a990fc8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788535967.101540:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788535967.101544:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535967.101548:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788535967.101552:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff97a986be0000) has no exports 00000020:00000080:0.0:1788535967.101558:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d381a 00000020:00000080:0.0:1788535967.101561:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a987b6d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788535967.101638:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9bf1ef800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788535967.101645:0:8:0:(genops.c:885:class_export_put()) final put ffff97a9b6b7b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788535967.101647:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9b6b7b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788535967.101651:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788535967.101727:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a990fc8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788535967.101732:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a987b6d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788535967.102482:0:12918:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788535967.102488:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788535967.102825:0:12918:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788535967.102832:0:12918:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788535967.102834:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788535967.102879:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788535967.102923:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a987b68800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788535967.103343:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788535967.103347:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a987b6e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788535967.103351:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff97a987b6e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788535967.103363:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788535967.103605:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535967.103610:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788535967.103613:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a98548f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788535967.103615:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff97a98548f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788535967.103619:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788535967.104209:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d36d1 00000020:00000080:0.0:1788535967.104217:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a9b7506000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788535967.104234:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788535967.104238:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535967.104258:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788535967.104262:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff97a9b74f0000) has no exports 00000020:00000080:1.0:1788535967.104278:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9b7506000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788535967.104286:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535967.104290:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788535967.104292:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a98a55e000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788535967.104294:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff97a98a55e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788535967.104298:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788535967.104533:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d36d8 00000020:00000080:0.0:1788535967.104538:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a9b7505800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788535967.104553:0:12918:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a9ac46a000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788535967.104556:0:12918:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a9ac46a000 3 00000020:01000004:0.0:1788535967.104559:0:12918:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97a9ac46a000 from lustre-MDT0000 00000020:00000080:0.0:1788535967.104577:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535967.104580:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788535967.104582:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a991101800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788535967.104584:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff97a991101800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788535967.104590:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788535967.104610:0:12918:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788535967.104613:0:12918:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788535967.104615:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788535967.104617:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535967.104624:0:12918:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788535967.104631:0:12918:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff97a9983d2000 ea5d41c9-12b3-443f-877d-8b3d703772fc 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788535967.104636:0:12918:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff97a986be3380) has exports, disconnecting them 00000020:00080000:0.0:1788535967.104641:0:12918:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97a9983d2000), last request at 1788535761 00000020:00000080:1.0:1788535967.104645:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9b7505800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788535967.104654:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3676 00000020:00010000:0.0:1788535967.104658:0:12918:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97a9983d2000: total 0 00000100:00080000:0.0:1788535967.104662:0:12918:0:(import.c:65:import_set_state_nolock()) ffff97a9880f0800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788535967.105019:0:12918:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a9983d2000): rc 0 00000020:00080000:0.0:1788535967.105024:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff97a986be3380) has no exports 00000100:00100000:0.0:1788535967.105079:0:5827:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97a983646e00:5827] 2 exiting: rc = 0 00000020:00010000:1.0:1788535967.105312:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97a9983d2000: total 0 00010000:00010000:1.0:1788535967.105343:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a9983d2000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788535967.105370:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980030400/0x74f51638375d3978 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d3971 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535967.105387:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a981652e00/0x74f51638375d3986 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d397f expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535967.105398:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980030a00/0x74f51638375d3994 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d398d expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535967.105408:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9b747e000/0x74f51638375d3bbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d3bb6 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535967.105433:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980031400/0x74f51638375d39a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d399b expref: 5 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535967.105444:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9c216d800/0x74f51638375d378e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d3787 expref: 4 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535967.105457:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9b747ec00/0x74f51638375d39cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d39c5 expref: 3 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535967.105468:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a98ab4ba00/0x74f51638375d3bcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74f51638375d3bc4 expref: 2 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535967.105477:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a9983d2000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788535967.105489:0:5822:0:(genops.c:885:class_export_put()) final put ffff97a9983d2000/ea5d41c9-12b3-443f-877d-8b3d703772fc 00010000:00010000:1.0:1788535967.105507:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535967.105509:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535967.105511:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535967.105560:0:5825:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97a983645400:5825] 0 exiting: rc = 1 00000100:00100000:2.0:1788535967.105566:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff97a987a6f400:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1788535967.105665:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.105674:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.105679:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.105685:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.105690:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788535967.105729:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9983d2000/ea5d41c9-12b3-443f-877d-8b3d703772fc for MGS 00000020:00000080:0.0:1788535967.105773:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9880f0800 for MGS 00000100:00100000:2.0:1788535967.105797:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.105879:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106125:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106134:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106140:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106153:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106163:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106167:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106173:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106179:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106185:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106191:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106198:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106203:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106210:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106215:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106221:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106227:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106232:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106237:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106243:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106259:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106266:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106271:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106276:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106282:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106287:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106293:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106298:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106304:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106308:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106314:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106319:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106325:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106330:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106335:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106339:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106344:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106350:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106355:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106368:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106374:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106379:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106384:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106389:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106394:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106399:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106404:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106409:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106416:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106422:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106427:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106432:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106438:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106443:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106448:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106459:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106465:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.106471:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788535967.107008:0:12918:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788535967.107012:0:12918:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788535967.108323:0:12918:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a9ba322900 - data ffff97a982085798/ffff97a9bf5b4000 00000020:01000000:3.0:1788535967.108512:0:12918:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a992465c60 - data ffff97a982270000/ffff97a987fe7800 00000020:00000080:3.0:1788535967.110212:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d365a 00000020:00000080:3.0:1788535967.110220:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a986e1e800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788535967.110242:0:12918:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a9ac46a000 from MGS, refs=2 00000020:01000004:3.0:1788535967.110246:0:12918:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a9ac46a000 2 00000020:01000004:3.0:1788535967.110257:0:12918:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97a9ac46a000 from MGS 00000020:00000080:3.0:1788535967.110282:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788535967.110288:0:12918:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788535967.110290:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a986e1b800/MGS 00000020:00000080:3.0:1788535967.110293:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff97a986e1b800/MGS for MGS 00000020:01000000:3.0:1788535967.110299:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788535967.110351:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788535967.110356:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788535967.110364:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788535967.110371:0:12918:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97a9b7506800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788535967.110377:0:12918:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff97a9b74f3380) has exports, disconnecting them 00000020:00080000:3.0:1788535967.110382:0:12918:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97a9b7506800), last request at 1788535763 00000020:00000080:3.0:1788535967.110386:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3725 00000020:00080000:3.0:1788535967.110400:0:12918:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a9b7506800): rc 0 00000020:00000080:3.0:1788535967.110404:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a9b7506800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788535967.110547:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a986e1e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788535967.110556:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9b7506800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788535967.116980:0:12918:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788535967.116988:0:12918:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788535967.116992:0:12918:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788535967.116999:0:12918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788535967.117023:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9b7500800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788535967.117387:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535967.117400:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788535967.117406:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a9b7502000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788535967.117504:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9b7502000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788535967.117511:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788535967.117567:0:12918:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a9ac46a000 1 00000020:00000080:0.0:1788535967.117572:0:12918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d364c 00000020:00000080:0.0:1788535967.117579:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a988598800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788535967.117593:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788535967.117598:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535967.117602:0:12918:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788535967.117605:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff97a990fa3380) has no exports 00000020:00000080:3.0:1788535967.118147:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97a988598800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788535967.233823:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788535967.233840:0:12918:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788535967.233845:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a98859e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788535967.233851:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff97a98859e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788535967.233861:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788535967.234073:0:12918:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97a98859d000 00000020:01000000:2.0:1788535967.234213:0:12918:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788535967.234218:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788535967.234223:0:12918:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788535967.234227:0:12918:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff97a986be4d40) has no exports 00000100:00100000:1.0:1788535967.234388:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff97a9885b1e00:5833] 1 exiting: rc = 0 00000100:00100000:0.0:1788535967.234392:0:11644:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff97a9bf190c00:11644] 4 exiting: rc = 0 00000100:00100000:0.0:1788535967.234489:0:5832:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff97a986aa4a00:5832] 0 exiting: rc = 1 00000100:00100000:3.0:1788535967.234855:0:5834:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff97a9885b1600:5834] 2 exiting: rc = 0 00000100:00100000:3.0:1788535967.234960:0:6697:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff97a9bf29e800:6697] 3 exiting: rc = 0 00000100:00100000:0.0:1788535967.235428:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235433:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235437:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235440:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235444:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235448:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235452:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235455:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235460:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235486:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235493:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235498:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235503:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235509:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235515:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235520:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235526:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235531:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235537:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235543:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235548:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235554:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235559:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235570:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235575:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235914:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235924:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235930:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235939:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235947:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235953:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235958:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235964:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235971:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235977:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235982:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235987:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.235993:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236003:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236008:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236013:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236019:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236025:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236032:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236139:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236144:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236150:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236156:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236163:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236169:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236178:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236184:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236190:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236199:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236207:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236217:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236225:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236232:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236241:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236260:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236271:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236282:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236294:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.236305:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535967.243489:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff97a99c78d600:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1788535967.246786:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff97a9885b1400:5835] 0 exiting: rc = 1 00000100:00100000:2.0:1788535967.247225:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247237:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247244:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247261:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247268:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247285:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247290:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247296:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247303:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247308:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247314:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247320:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247326:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247332:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247339:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247344:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247349:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247355:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247360:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247365:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247370:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247376:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247381:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247386:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247391:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247396:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247400:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247406:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247411:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247416:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247421:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247425:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247430:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247435:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247440:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247445:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247451:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247456:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247461:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247466:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247480:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247486:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247491:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247496:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247500:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247506:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247511:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247517:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247522:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247527:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247532:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247537:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247542:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247547:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247552:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247558:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247563:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247568:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247573:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247578:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247583:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247588:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247594:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.247599:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.248103:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff97a9885b0800:5838] 1 exiting: rc = 0 00000100:00100000:2.0:1788535967.252547:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff97a99c6c6400:5837] 0 exiting: rc = 1 00000100:00100000:1.0:1788535967.252716:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252739:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252746:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252752:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252758:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252763:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252784:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252791:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252797:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252803:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252809:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252829:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252835:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252841:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252848:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252853:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252858:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252864:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252884:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252921:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252927:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252933:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252939:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252944:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252950:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252956:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252961:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252967:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252974:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.252980:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253000:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253007:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253012:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253017:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253023:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253029:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253034:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253040:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253045:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253051:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253056:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253063:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253084:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253091:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253097:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253103:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253115:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253120:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253126:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253132:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253139:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253146:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253152:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253158:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253180:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253189:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253194:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253199:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253209:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253215:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253220:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253226:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253232:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.253245:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535967.267424:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff97a9885b0c00:5839] 0 exiting: rc = 1 00000100:00100000:2.0:1788535967.267544:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff97a9885b1200:5840] 1 exiting: rc = 0 00000100:00100000:1.0:1788535967.267659:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267668:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267674:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267679:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267685:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267690:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267696:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267702:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267707:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267712:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267718:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267723:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267728:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267733:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267738:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267744:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267748:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267772:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267778:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267783:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267789:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267795:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267800:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267806:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267813:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267818:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267823:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267827:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267832:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267837:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267844:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267852:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267856:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267861:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267866:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267871:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267876:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.267881:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269095:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269110:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269115:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269120:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269124:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269129:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269134:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269138:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269143:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269148:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269152:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269157:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269161:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269166:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269182:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269188:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269192:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269197:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269202:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269207:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269212:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269218:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269224:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269229:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269234:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.269239:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.274843:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff97a99c963e00:5841] 0 exiting: rc = 1 00000100:00100000:1.0:1788535967.275177:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff97a99c963600:5842] 1 exiting: rc = 0 00000100:00100000:3.0:1788535967.275288:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275296:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275316:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275321:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275326:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275331:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275335:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275340:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275346:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275351:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275355:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275360:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275365:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275371:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275376:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275381:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275385:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275389:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275394:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275399:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275404:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275408:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275413:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275418:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275423:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275428:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275434:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275439:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275444:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275448:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275453:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275458:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275463:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275467:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275472:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275477:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275482:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275495:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275500:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275505:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275510:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275515:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275520:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275525:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275529:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275535:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275541:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275546:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275551:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275557:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275562:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275566:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275571:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275576:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275581:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275586:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275591:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275596:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275602:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275607:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275612:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275617:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275622:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.275627:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.276153:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff97a986aa7000:5844] 1 exiting: rc = 0 00000100:00100000:0.0:1788535967.276468:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff97a986aa6e00:5843] 0 exiting: rc = 1 00000100:00100000:3.0:1788535967.276557:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276562:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276568:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276573:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276578:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276584:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276589:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276595:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276611:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276617:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276622:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276628:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276633:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276649:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276654:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276659:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276663:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276668:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276673:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276678:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276682:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276688:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276692:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276697:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276701:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276706:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276711:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276716:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276721:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276726:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276731:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276736:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276740:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276745:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276749:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276755:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276760:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276765:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276770:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276775:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276780:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276785:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276790:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276803:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276809:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276814:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276819:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276825:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276830:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276834:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276839:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276844:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276849:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276853:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276859:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276863:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276868:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276874:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276878:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276883:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276929:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276935:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276940:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.276945:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535967.277983:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff97a99c78c200:5846] 1 exiting: rc = 0 00000100:00100000:1.0:1788535967.278136:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff97a986aa6800:5847] 2 exiting: rc = 0 00000100:00100000:0.0:1788535967.278367:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff97a986a9de00:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1788535967.278468:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278476:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278482:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278488:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278494:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278499:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278505:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278510:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278516:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278522:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278528:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278533:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278540:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278545:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278562:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278568:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278573:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278579:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278584:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278590:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278595:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278612:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278618:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278624:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278629:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278648:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278655:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278661:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278666:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278672:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278678:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278684:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278690:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278695:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278701:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278706:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278711:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278717:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278721:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278727:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278731:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278737:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278742:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278747:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278753:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278773:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278781:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278786:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278792:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278805:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278810:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278814:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278820:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278825:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278831:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278836:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278841:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278845:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278851:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278857:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278862:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278869:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278874:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535967.278879:0:12918:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788535967.284163:0:12918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788535967.284178:0:12918:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788535967.284184:0:12918:0:(genops.c:885:class_export_put()) final put ffff97a987bb8000/MDS_uuid 00000020:00000080:3.0:1788535967.284188:0:12918:0:(genops.c:844:class_export_destroy()) destroying export ffff97a987bb8000/MDS_uuid for MDS 00000020:01000000:3.0:1788535967.284193:0:12918:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788535967.284423:0:12918:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1788535967.505612:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607100032:0@lo:400:kworker.0 00000400:00000100:1.0:1788535967.505667:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415607100032 offset 0 length 224: 4 00000100:00100000:1.0:1788535967.506151:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788535967.506161:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875415607099904:0@lo:400:kworker.0 00000400:00000100:1.0:1788535967.506187:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415607099904 offset 0 length 224: 4 00000100:00100000:3.0:1788535967.507981:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535967.508007:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607099776:0@lo:400:kworker.0 00000400:00000100:3.0:1788535967.508056:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875415607099776 offset 0 length 224: 4 00010000:00010000:3.0:1788535967.629754:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535968.653032:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535969.676983:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788535969.813973:0:13071:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788535969.826724:0:13071:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788535969.826837:0:13071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535969.826852:0:13071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535969.826877:0:13071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535969.827063:0:13071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535969.827086:0:13071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788535969.827091:0:13071:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788535969.827113:0:13071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1788535969.827181:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535969.827189:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535969.827197:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e400 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535969.827201:0:6687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535969.827221:0:6687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535969.827237:0:6687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535969.827242:0:6687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788535969.827244:0:6687:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788535969.827247:0:6687:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788535969.827293:0:6687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535969.827300:0:6687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535969.827330:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535969.827337:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d398d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x74f51638375d3994 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535969.827351:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535969.827352:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535969.827354:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535969.827537:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607100160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788535969.827603:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535969.827717:0:13071:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a9bf76ad80 x1875415607099904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535983 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535969.827741:0:13071:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788535969.827748:0:13071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788535969.827801:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875415607099904:0@lo:400:kworker.0 00000100:00080000:2.0:1788535969.827832:0:13071:0:(import.c:65:import_set_state_nolock()) ffff97a9bf5c5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788535969.827921:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875415607100288:0@lo:39:umount.0 00000400:00000100:1.0:1788535969.827946:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415607100288 offset 0 length 224: 4 00000100:00100000:3.0:1788535969.828066:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607100160 00000100:00100000:3.0:1788535969.828073:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607100160 00000100:00100000:3.0:1788535969.828117:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788535969.828125:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3310:x1875415607100160:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788535969.828132:0:7598:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788535969 with bad export cookie 8427666708396586614 00000100:00100000:2.0:1788535969.841747:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3310:x1875415607100160:12345-0@lo:103:ldlm_bl.0 Request processed in 13613us (14136us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788535969.842041:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788535969.842156:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.112@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788535969.842162:0:3310:0:(import.c:65:import_set_state_nolock()) ffff97a987bb9000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788535969.842171:0:3310:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788535969.852844:0:3310:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.112@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788535969.852849:0:3310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788535969.852860:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a9bf76a300 x1875415607099776/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788535983 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535969.853110:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a9bf769180 x1875415607100160/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788535985 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788535969.853119:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788535969.853122:0:3310:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788535969.853124:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788535969.853127:0:3310:0:(import.c:65:import_set_state_nolock()) ffff97a987bb9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788535969.853133:0:3310:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 163 00000100:00080000:0.0:1788535969.853141:0:3310:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import ffff97a987bb9000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788535969.853248:0:3310:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b7414380 x1875415607100416/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788535969.853330:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607099776:0@lo:400:kworker.0 00000100:00100000:3.0:1788535969.853338:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea5d41c9-12b3-443f-877d-8b3d703772fc:3307:1875415607100416:0@lo:250:ptlrpcd_00_02.0 00000100:00100000:1.0:1788535969.853357:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea5d41c9-12b3-443f-877d-8b3d703772fc:3310:1875415607100160:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1788535969.853395:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875415607100416 offset 0 length 520: 4 00010000:00010000:1.0:1788535970.700983:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535971.725064:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788535972.621346:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ea5d41c9-12b3-443f-877d-8b3d703772fc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788535972.621354:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ea5d41c9-12b3-443f-877d-8b3d703772fc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788535972.621425:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607100544:0@lo:400:kworker.0 00000400:00000100:0.0:1788535972.621480:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415607100544 offset 0 length 224: 4 00010000:00010000:3.0:1788535972.750052:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535973.773755:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788535974.671293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ea5d41c9-12b3-443f-877d-8b3d703772fc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788535974.671303:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ea5d41c9-12b3-443f-877d-8b3d703772fc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788535974.671421:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607100672:0@lo:400:kworker.0 00000400:00000100:2.0:1788535974.671475:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415607100672 offset 0 length 224: 4 00010000:00010000:1.0:1788535974.797039:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535975.821136:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535976.845242:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535977.869033:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535978.896550:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535979.277079:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788535969/real 1788535969] req@ffff97a9b7414380 x1875415607100416/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788535979 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535979.277110:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a9b7414380 x1875415607100416/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788535979 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535979.277121:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788535969/real 1788535969] req@ffff97a9b740ad80 x1875415607100288/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788535979 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535979.277134:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a9b740ad80 x1875415607100288/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788535979 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788535979.277151:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a987bb9000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788535979.277184:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788535979.277189:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea5d41c9-12b3-443f-877d-8b3d703772fc:3307:1875415607100416:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1788535979.277196:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a9bf5c5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788535979.277211:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875415607100288:0@lo:39:umount.0 00000100:00080000:0.0:1788535979.277627:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ea5d41c9-12b3-443f-877d-8b3d703772fc->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788535979.277633:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788535979.277636:0:36:0:(import.c:65:import_set_state_nolock()) ffff97a987bb9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788535979.277641:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 371 00000100:00080000:0.0:1788535979.277646:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788535979.277651:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import ffff97a987bb9000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788535979.277681:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b6ac2d80 x1875415607100800/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788535979.277756:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea5d41c9-12b3-443f-877d-8b3d703772fc:3307:1875415607100800:0@lo:250:kworker.0 00000100:00100000:1.0:1788535979.277758:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607100928:0@lo:400:kworker.0 00000100:00080000:2.0:1788535979.277842:0:13071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788535979.277847:0:13071:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788535979.277851:0:13071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788535979.279505:0:13071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535979.279523:0:13071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535979.279545:0:13071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535979.279551:0:13071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535979.279572:0:13071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788535979.279579:0:13071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535979.279585:0:13071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535979.279591:0:13071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535979.279597:0:13071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535979.279613:0:13071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788535979.279617:0:13071:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788535979.279638:0:13071:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788535979.279642:0:13071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788535979.279647:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788535979.279652:0:13071:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788535979.279657:0:13071:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff97a9b91d3380) has no exports 00000020:00080000:2.0:1788535979.279679:0:13071:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff97a9b91d3380) has no exports 00010000:00010000:3.0:1788535979.280131:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788535979.280140:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535979.280148:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f600 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535979.280160:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535979.280180:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535979.280187:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535979.280193:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788535979.280196:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788535979.280199:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788535979.280213:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a987bb9000 00010000:00010000:3.0:1788535979.280217:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:0.0:1788535979.280222:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875415607100800 offset 0 length 520: 4 00010000:00010000:3.0:1788535979.280229:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d399b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x74f51638375d39a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535979.280247:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535979.280250:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535979.280257:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4be00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535979.280260:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535979.280266:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535979.280273:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535979.280286:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788535979.280288:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788535979.280290:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788535979.280299:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a987bb9000 00010000:00010000:0.0:1788535979.280299:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535979.280317:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535979.280325:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a98ab4be00/0x74f51638375d3bc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x74f51638375d3bcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535979.280334:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535979.280335:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535979.280337:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788535979.281213:0:13071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a987ab4180 - data ffff97a9bf87e288/ffff97a9bf599400 00000020:01000000:2.0:1788535979.281349:0:13071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a9921276c0 - data ffff97a992f52bd0/ffff97a9b63aec00 00000400:00000100:1.0:1788535979.284244:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415607100928 offset 0 length 224: 4 00100000:10000000:2.0:1788535979.296377:0:13071:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788535979.335612:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d37aa 00000020:00000080:0.0:1788535979.335621:0:13071:0:(genops.c:885:class_export_put()) final put ffff97a9bf2e7800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788535979.335664:0:13071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a9a7dac800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788535979.335668:0:13071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a9a7dac800 2 00000020:01000004:0.0:1788535979.335671:0:13071:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97a9a7dac800 from lustre-OST0000 00000020:00000080:0.0:1788535979.335696:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535979.335705:0:13071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788535979.335708:0:13071:0:(genops.c:885:class_export_put()) final put ffff97a9bf2e5800/lustre-OST0000_UUID 00000020:00000080:0.0:1788535979.335711:0:13071:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bf2e5800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788535979.335717:0:13071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788535979.335754:0:13071:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788535979.335758:0:13071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788535979.335762:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535979.335766:0:13071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788535979.335773:0:13071:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff97a9bf5c3800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788535979.335778:0:13071:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff97a990fa0000) has exports, disconnecting them 00000020:00080000:0.0:1788535979.335783:0:13071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff97a9bf5c3800), last request at 1788535779 00000020:00000080:0.0:1788535979.335786:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d37d4 00000020:00080000:0.0:1788535979.335796:0:13071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a9bf5c3800): rc 0 00000020:00000080:0.0:1788535979.335800:0:13071:0:(genops.c:885:class_export_put()) final put ffff97a9bf5c3800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788535979.336477:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bf2e7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788535979.336490:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bf5c3800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788535979.351712:0:13071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788535979.351720:0:13071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788535979.351723:0:13071:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788535979.351730:0:13071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788535979.351910:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788535979.351918:0:13071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788535979.351924:0:13071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a9a7dac800 1 00000020:00000080:2.0:1788535979.351930:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3764 00000020:00000080:2.0:1788535979.351938:0:13071:0:(genops.c:885:class_export_put()) final put ffff97a986ffa000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788535979.351944:0:13071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788535979.351948:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788535979.351952:0:13071:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788535979.351955:0:13071:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff97a9b91d0000) has no exports 00000020:00000080:3.0:1788535979.353810:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9bf5c5800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788535979.353824:0:36:0:(genops.c:885:class_export_put()) final put ffff97a986ff9000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788535979.353827:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a986ff9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788535979.353834:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788535979.353922:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a986ffa000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788535979.381544:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788535979.381561:0:13071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788535979.381566:0:13071:0:(genops.c:885:class_export_put()) final put ffff97a9a7dad000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788535979.381570:0:13071:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9a7dad000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788535979.381582:0:13071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788535979.381744:0:13071:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97a9a7dae800 00000020:02000400:3.0:1788535979.381787:0:13071:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788535979.918552:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535980.941400:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788535981.861774:0:13223:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788535981.882838:0:13223:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788535981.882946:0:13223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535981.882961:0:13223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535981.882969:0:13223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535981.882988:0:13223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535981.883013:0:13223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788535981.883018:0:13223:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788535981.883038:0:13223:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788535981.883061:0:13223:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a9bf768a80 x1875415607100032/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535983 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535981.883087:0:13223:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a9b6ac2a00 x1875415607100544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535988 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788535981.883089:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788535981.883101:0:13223:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a9bf76bb80 x1875415607100672/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535990 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788535981.883104:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535981.883121:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f400 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788535981.883126:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535981.883128:0:13223:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a9b6ac3480 x1875415607100928/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535995 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788535981.883157:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535981.883158:0:13223:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 10000000:00010000:3.0:1788535981.883169:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535981.883175:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788535981.883193:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875415607100672:0@lo:400:kworker.0 00000100:00080000:2.0:1788535981.883220:0:13223:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788535981.883244:0:13223:0:(import.c:65:import_set_state_nolock()) ffff97a9ac7b6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:3.0:1788535981.883342:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788535981.883345:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788535981.883360:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a987bb9000 00010000:00010000:3.0:1788535981.883365:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535981.883372:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9b747f400/0x74f51638375d3971 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x74f51638375d3978 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535981.883378:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607100544:0@lo:400:kworker.0 00010000:00010000:3.0:1788535981.883387:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535981.883390:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535981.883392:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535981.883415:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875415607101056:0@lo:39:umount.0 00000100:00100000:1.0:1788535981.883462:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607100928:0@lo:400:kworker.0 00000100:00100000:1.0:1788535981.883474:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875415607100032:0@lo:400:kworker.0 00000400:00000100:0.0:1788535981.883480:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415607101056 offset 0 length 224: 4 00010000:00010000:0.0:1788535981.965165:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535982.989097:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535984.013067:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788535984.399601:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ea5d41c9-12b3-443f-877d-8b3d703772fc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788535984.399611:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ea5d41c9-12b3-443f-877d-8b3d703772fc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788535985.037106:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535986.063143:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535987.085120:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535988.109051:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535989.133136:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788535989.517563:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ea5d41c9-12b3-443f-877d-8b3d703772fc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788535989.517573:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ea5d41c9-12b3-443f-877d-8b3d703772fc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788535990.157245:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535991.055274:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788535981/real 1788535981] req@ffff97a9b740b480 x1875415607101056/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788535991 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535991.055308:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a9b740b480 x1875415607101056/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788535991 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788535991.055327:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a9ac7b6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788535991.055348:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875415607101056:0@lo:39:umount.0 00000100:00080000:0.0:1788535991.058221:0:13223:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788535991.058242:0:13223:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788535991.058249:0:13223:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788535991.060782:0:13223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535991.060802:0:13223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535991.060809:0:13223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535991.060817:0:13223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535991.060847:0:13223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788535991.060855:0:13223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535991.060862:0:13223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535991.060868:0:13223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535991.060873:0:13223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535991.061019:0:13223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788535991.061025:0:13223:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788535991.061059:0:13223:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788535991.061063:0:13223:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788535991.061067:0:13223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535991.061072:0:13223:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788535991.061077:0:13223:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff97a9b713b380) has no exports 00000020:00080000:0.0:1788535991.061182:0:13223:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff97a9b713b380) has no exports 00000020:01000000:0.0:1788535991.069046:0:13223:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a987ab4060 - data ffff97a9bfa17870/ffff97a9ba234400 00000020:01000000:0.0:1788535991.069201:0:13223:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a9b6edfde0 - data ffff97a9bf86fa20/ffff97a9bfca8c00 00010000:00010000:1.0:1788535991.069762:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788535991.069772:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535991.069783:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fc00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:1.0:1788535991.069787:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535991.069797:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535991.069823:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535991.069829:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788535991.069832:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788535991.069835:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788535991.069849:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a987bb9000 00010000:00010000:1.0:1788535991.069853:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535991.069860:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9b747fc00/0x74f51638375d397f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x74f51638375d3986 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535991.069871:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535991.069875:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535991.069881:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c2050e00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:1.0:1788535991.069884:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535991.069920:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535991.069927:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535991.069932:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788535991.069934:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788535991.069940:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788535991.069947:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a987bb9000 00010000:00010000:1.0:1788535991.069950:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535991.069956:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9c2050e00/0x74f51638375d3bb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x74f51638375d3bbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535991.069969:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535991.069971:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535991.069973:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535991.070322:0:6687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788535991.086220:0:13223:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788535991.132179:0:13223:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3875 00000020:00000080:2.0:1788535991.132190:0:13223:0:(genops.c:885:class_export_put()) final put ffff97a9a7da9800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788535991.132210:0:13223:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a986ffc800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788535991.132214:0:13223:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a986ffc800 2 00000020:01000004:2.0:1788535991.132222:0:13223:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97a986ffc800 from lustre-OST0001 00000020:00000080:1.0:1788535991.132278:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9a7da9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788535991.132451:0:13223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788535991.132468:0:13223:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788535991.132471:0:13223:0:(genops.c:885:class_export_put()) final put ffff97a9bf5c2800/lustre-OST0001_UUID 00000020:00000080:2.0:1788535991.132473:0:13223:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bf5c2800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788535991.132480:0:13223:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788535991.133261:0:13223:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ea5d41c9-12b3-443f-877d-8b3d703772fc->MGS 00010000:00010000:2.0:1788535991.133282:0:13223:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9c216d200/0x74f51638375d3787 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x74f51638375d378e expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535991.133719:0:13223:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9c216d200/0x74f51638375d3787 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x74f51638375d378e expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535991.133727:0:13223:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788535991.133730:0:13223:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788535991.133733:0:13223:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788535991.134129:0:13223:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a987bb9000 00010000:00010000:2.0:1788535991.134136:0:13223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9c216d200/0x74f51638375d3787 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x74f51638375d378e expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535991.134159:0:13223:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d39c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x74f51638375d39cc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535991.134166:0:13223:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d39c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x74f51638375d39cc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535991.134172:0:13223:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788535991.134175:0:13223:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788535991.134177:0:13223:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788535991.134190:0:13223:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a987bb9000 00010000:00010000:2.0:1788535991.134193:0:13223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a98ab4a000/0x74f51638375d39c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x74f51638375d39cc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788535991.134232:0:13223:0:(import.c:65:import_set_state_nolock()) ffff97a987bb9000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788535991.134237:0:13223:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788535991.134240:0:13223:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788535991.134242:0:13223:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788535991.134247:0:13223:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788535991.134842:0:13223:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a9b6ac2d80 x1875415607100800/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788535994 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788535991.135029:0:13223:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788535991.135033:0:13223:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:0.0:1788535991.142750:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea5d41c9-12b3-443f-877d-8b3d703772fc:3307:1875415607100800:0@lo:250:kworker.0 10000000:01000000:2.0:1788535991.142808:0:13223:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788535991.142821:0:13223:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3668 00000020:00000080:2.0:1788535991.142829:0:13223:0:(genops.c:885:class_export_put()) final put ffff97a987bbc800/ea5d41c9-12b3-443f-877d-8b3d703772fc 00000020:01000000:2.0:1788535991.142849:0:13223:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.112@tcp (flags='') 00000020:00000080:2.0:1788535991.142854:0:13223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788535991.142860:0:13223:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.112@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788535991.142864:0:13223:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff97a986be19c0) has no exports 00000020:00000080:1.0:1788535991.142908:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a987bbc800/ea5d41c9-12b3-443f-877d-8b3d703772fc for MGC192.168.203.112@tcp 10000000:01000000:0.0:1788535991.143008:0:5830:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788535991.143213:0:13223:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.112@tcp: client import never connected 00000100:00080000:2.0:1788535991.143561:0:13223:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788535991.143566:0:13223:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788535991.143569:0:13223:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788535991.143572:0:13223:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788535991.143662:0:13223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788535991.143670:0:13223:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.112@tcp (uuid ea5d41c9-12b3-443f-877d-8b3d703772fc) 00000020:01000000:2.0:1788535991.143677:0:13223:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788535991.143685:0:13223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788535991.143721:0:13223:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788535991.143728:0:13223:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff97a9bf2e2000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788535991.143733:0:13223:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff97a9b91d19c0) has exports, disconnecting them 00000020:00080000:2.0:1788535991.143738:0:13223:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff97a9bf2e2000), last request at 1788535796 00000020:00000080:2.0:1788535991.143742:0:13223:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d389f 00000020:00080000:2.0:1788535991.143770:0:13223:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a9bf2e2000): rc 0 00000020:00000080:2.0:1788535991.143775:0:13223:0:(genops.c:885:class_export_put()) final put ffff97a9bf2e2000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788535991.146143:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a987bb9000 for MGC192.168.203.112@tcp 00000020:00000080:1.0:1788535991.146160:0:36:0:(genops.c:885:class_export_put()) final put ffff97a987bba800/ea5d41c9-12b3-443f-877d-8b3d703772fc 00000020:00000080:1.0:1788535991.146164:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a987bba800/ea5d41c9-12b3-443f-877d-8b3d703772fc for MGC192.168.203.112@tcp 00000020:01000000:1.0:1788535991.146172:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.112@tcp (ea5d41c9-12b3-443f-877d-8b3d703772fc) 00000020:00000080:1.0:1788535991.152570:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bf2e2000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788535991.154335:0:13223:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788535991.154384:0:13223:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788535991.154388:0:13223:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788535991.154395:0:13223:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788535991.154462:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97a9ac7b6800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788535991.154750:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788535991.155220:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788535991.156590:0:6687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788535991.156967:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff97a987be0200:5817] 1 exiting: rc = 0 00000100:00100000:1.0:1788535991.157233:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff97a987be0400:5816] 0 exiting: rc = 1 00000100:00100000:1.0:1788535991.157542:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.158186:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff97a987f8e600:5820] 2 exiting: rc = 0 00000100:00100000:1.0:1788535991.158287:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff97a98a694a00:5819] 1 exiting: rc = 0 00000100:00100000:2.0:1788535991.162577:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff97a9883e0c00:5818] 0 exiting: rc = 1 00000100:00100000:2.0:1788535991.163030:0:7598:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff97a9b91bf800:7598] 3 exiting: rc = 0 00000100:00100000:1.0:1788535991.163706:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163717:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163725:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163731:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163736:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163753:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163758:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163764:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163770:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163774:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163780:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163785:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163797:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163802:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163809:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163816:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163821:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163827:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163832:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163837:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163843:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163850:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163855:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163861:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163866:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163871:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.163877:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164000:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164006:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164011:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164016:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164021:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164026:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164030:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164035:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164040:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164045:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164050:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164055:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164060:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164073:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164078:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164094:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164099:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164104:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164109:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164114:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164119:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164123:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164127:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164132:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164136:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164141:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164145:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164347:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164353:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164358:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164372:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164376:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164517:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164524:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164528:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164533:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.164539:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788535991.166839:0:13223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788535991.166849:0:13223:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788535991.166855:0:13223:0:(genops.c:885:class_export_put()) final put ffff97a9bf2e4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788535991.166860:0:13223:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bf2e4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788535991.166868:0:13223:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788535991.167034:0:13223:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a986ffc800 1 00000020:00000080:1.0:1788535991.167041:0:13223:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x74f51638375d3844 00000020:00000080:1.0:1788535991.167047:0:13223:0:(genops.c:885:class_export_put()) final put ffff97a9bf153000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788535991.167111:0:13223:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788535991.167116:0:13223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788535991.167129:0:13223:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788535991.167133:0:13223:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff97a9ac7a8000) has no exports 00000020:00000080:2.0:1788535991.168600:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a9bf153000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788535991.211106:0:13223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788535991.211122:0:13223:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788535991.211128:0:13223:0:(genops.c:885:class_export_put()) final put ffff97a990fca800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788535991.211132:0:13223:0:(genops.c:844:class_export_destroy()) destroying export ffff97a990fca800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788535991.211140:0:13223:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788535991.214209:0:13223:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97a990fcc800 00000020:01000000:1.0:1788535991.215410:0:13223:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788535991.215420:0:13223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788535991.215427:0:13223:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788535991.215432:0:13223:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff97a990fa4d40) has no exports 00000020:00000080:1.0:1788535991.215478:0:13223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788535991.215488:0:13223:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788535991.215493:0:13223:0:(genops.c:885:class_export_put()) final put ffff97a986fff000/OSS_uuid 00000020:00000080:1.0:1788535991.215496:0:13223:0:(genops.c:844:class_export_destroy()) destroying export ffff97a986fff000/OSS_uuid for OSS 00000020:01000000:1.0:1788535991.215502:0:13223:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788535991.215610:0:12429:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff97a9bf190800:12429] 4 exiting: rc = 0 00000100:00100000:3.0:1788535991.215615:0:6671:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff97a9854ef200:6671] 0 exiting: rc = 1 00000100:00080000:0.0:1788535991.215873:0:5829:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788535991.217030:0:6673:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff97a986a98e00:6673] 1 exiting: rc = 0 00000100:00100000:1.0:1788535991.217634:0:6674:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff97a990d6de00:6674] 2 exiting: rc = 0 00000100:00100000:1.0:1788535991.217688:0:8424:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff97a9c0b02200:8424] 3 exiting: rc = 0 00000100:00100000:0.0:1788535991.221355:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221375:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221388:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221396:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221401:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221406:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221411:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221417:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221421:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221426:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221432:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221437:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221442:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221448:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221453:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221458:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221462:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221467:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221471:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221476:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221497:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221502:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221507:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221512:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221516:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221521:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221528:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221533:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221538:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221542:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221547:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221552:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221556:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221561:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221566:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221571:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221576:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221582:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221586:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221592:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221597:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221602:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221609:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221614:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221619:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221624:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221628:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221633:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221638:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221644:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221649:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221654:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221660:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221665:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221669:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221682:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221688:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221693:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221845:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221853:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221858:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221863:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221867:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.221872:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535991.227913:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff97a982c32400:6676] 1 exiting: rc = 0 00000100:00100000:2.0:1788535991.236367:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff97a990d6dc00:6675] 0 exiting: rc = 1 00000100:00100000:0.0:1788535991.241101:0:10342:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff97a9bf26de00:10342] 2 exiting: rc = 0 00000100:00100000:2.0:1788535991.241263:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241275:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241281:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241286:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241292:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241297:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241302:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241308:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241313:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241318:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241323:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241328:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241333:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241338:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241343:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241349:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241354:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241358:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241373:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241404:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241411:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241440:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241446:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241451:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241456:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241461:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241466:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241475:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241481:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241486:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241491:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241496:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241501:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241506:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241511:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241517:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241523:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241529:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241534:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241539:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241544:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241548:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241553:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241557:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241561:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241566:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241571:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241575:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241580:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241585:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241589:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241594:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241599:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241603:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241608:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241613:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241626:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241631:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241636:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241641:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241646:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241651:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241656:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.241670:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.243644:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff97a989113a00:6678] 1 exiting: rc = 0 00000100:00100000:0.0:1788535991.244058:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff97a9b91bf200:6677] 0 exiting: rc = 1 00000100:00100000:3.0:1788535991.244354:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff97a989113000:6679] 2 exiting: rc = 0 00000100:00100000:0.0:1788535991.244633:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244641:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244647:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244655:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244660:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244666:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244672:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244678:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244685:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244691:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244710:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244720:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244729:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244737:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244745:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244752:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244760:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244769:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244775:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244781:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244786:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244792:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244812:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244818:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244824:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244829:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244835:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244855:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244862:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244868:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.244874:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245030:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245039:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245044:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245049:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245055:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245060:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245065:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245070:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245076:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245093:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245100:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245106:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245111:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245119:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245125:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245130:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245135:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245140:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245145:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245151:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245156:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245163:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245169:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245176:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245182:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245440:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245457:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245463:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245469:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245475:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245480:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245486:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.245493:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535991.255105:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff97a989113400:6680] 0 exiting: rc = 1 00000100:00100000:3.0:1788535991.258140:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff97a989113e00:6681] 1 exiting: rc = 0 00000100:00100000:0.0:1788535991.258422:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258433:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258438:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258444:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258449:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258454:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258460:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258465:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258469:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258474:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258479:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258484:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258489:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258495:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258500:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258504:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258509:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258513:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258518:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258522:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258527:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258532:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258538:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258543:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258548:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258554:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258559:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258564:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258585:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258590:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258595:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258600:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258605:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258610:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258616:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258621:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258626:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258631:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258636:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258641:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258645:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258650:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258655:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258660:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258665:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258670:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258675:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258680:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258686:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258691:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258696:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258803:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258809:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258815:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258820:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258826:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258831:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258838:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258843:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258849:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258854:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258858:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258863:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535991.258874:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535991.267503:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff97a987af4c00:6682] 0 exiting: rc = 1 00000100:00100000:0.0:1788535991.273100:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff97a987af5800:6683] 1 exiting: rc = 0 00000100:00100000:1.0:1788535991.273274:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273283:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273290:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273297:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273303:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273308:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273313:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273319:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273337:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273343:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273349:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273355:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273360:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273379:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273384:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273390:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273397:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273403:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273409:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273415:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273434:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273441:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273447:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273453:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273460:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273466:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273473:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273479:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273485:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273491:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273499:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273505:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273525:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273532:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273539:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273545:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273551:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273557:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273564:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273571:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273577:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273583:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273589:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273595:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273616:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273625:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273634:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273639:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273656:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273662:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273667:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273673:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273678:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273684:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273690:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273697:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273720:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273727:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273733:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273740:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273746:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273751:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273758:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535991.273764:0:13223:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788535991.297801:0:13223:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788536008.007941:0:13840:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788536016.070963:0:14302:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788536016.070968:0:14302:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788536016.071064:0:14302:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a988040000 00000020:01000004:1.0:1788536016.071080:0:14302:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788536016.071088:0:14302:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788536016.071100:0:14302:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97a9b67c8000) 00000020:00000080:1.0:1788536016.071112:0:14302:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788536016.083015:0:14302:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788536016.084367:0:14302:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788536016.084780:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 427: rc = 0 00100000:10000000:2.0:1788536016.084876:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 427: rc = 0 00100000:10000000:2.0:1788536016.085008:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 427: rc = 0 00100000:10000000:2.0:1788536016.085096:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 427: rc = 0 00100000:10000000:2.0:1788536016.085197:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 427: rc = 0 00100000:10000000:2.0:1788536016.085392:0:14302:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788536016.085463:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 427: rc = 0 00100000:10000000:3.0:1788536016.086409:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 429: rc = 0 00100000:10000000:3.0:1788536016.087488:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 769: rc = 0 00100000:10000000:3.0:1788536016.087593:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 769: rc = 0 00100000:10000000:3.0:1788536016.088190:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 656: rc = 0 00100000:10000000:3.0:1788536016.088536:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 656: rc = 0 00100000:10000000:3.0:1788536016.088783:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 656: rc = 0 00100000:10000000:3.0:1788536016.089066:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 656: rc = 0 00100000:10000000:3.0:1788536016.089311:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 656: rc = 0 00100000:10000000:3.0:1788536016.089533:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 656: rc = 0 00100000:10000000:3.0:1788536016.089779:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 656: rc = 0 00100000:10000000:3.0:1788536016.090197:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 656: rc = 0 00100000:10000000:3.0:1788536016.090388:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 656: rc = 0 00100000:10000000:3.0:1788536016.090615:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 656: rc = 0 00100000:10000000:3.0:1788536016.090864:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 656: rc = 0 00100000:10000000:3.0:1788536016.091180:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 656: rc = 0 00100000:10000000:3.0:1788536016.091602:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 678: rc = 0 00100000:10000000:3.0:1788536016.091813:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 678: rc = 0 00100000:10000000:3.0:1788536016.092141:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 678: rc = 0 00100000:10000000:3.0:1788536016.092366:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 678: rc = 0 00100000:10000000:3.0:1788536016.092594:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 678: rc = 0 00100000:10000000:3.0:1788536016.092807:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 678: rc = 0 00100000:10000000:3.0:1788536016.093093:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 678: rc = 0 00100000:10000000:3.0:1788536016.093305:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 678: rc = 0 00100000:10000000:3.0:1788536016.093558:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 678: rc = 0 00100000:10000000:3.0:1788536016.093798:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 678: rc = 0 00100000:10000000:3.0:1788536016.094177:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 678: rc = 0 00100000:10000000:3.0:1788536016.094437:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 678: rc = 0 00100000:10000000:3.0:1788536016.094940:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 678: rc = 0 00100000:10000000:3.0:1788536016.095180:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 678: rc = 0 00100000:10000000:3.0:1788536016.095430:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 678: rc = 0 00100000:10000000:3.0:1788536016.095667:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 678: rc = 0 00100000:10000000:3.0:1788536016.096017:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 678: rc = 0 00100000:10000000:3.0:1788536016.096265:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 678: rc = 0 00100000:10000000:3.0:1788536016.096513:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 678: rc = 0 00100000:10000000:3.0:1788536016.096759:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 678: rc = 0 00100000:10000000:3.0:1788536016.097071:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 678: rc = 0 00100000:10000000:3.0:1788536016.097325:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 678: rc = 0 00100000:10000000:3.0:1788536016.097624:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 678: rc = 0 00100000:10000000:3.0:1788536016.097879:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 678: rc = 0 00100000:10000000:3.0:1788536016.098343:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 678: rc = 0 00100000:10000000:3.0:1788536016.098591:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 678: rc = 0 00100000:10000000:3.0:1788536016.098850:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 678: rc = 0 00100000:10000000:3.0:1788536016.099170:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 678: rc = 0 00100000:10000000:3.0:1788536016.099411:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 678: rc = 0 00100000:10000000:3.0:1788536016.099659:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 678: rc = 0 00100000:10000000:3.0:1788536016.100191:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 678: rc = 0 00100000:10000000:3.0:1788536016.100442:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 678: rc = 0 00100000:10000000:3.0:1788536016.100792:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 435: rc = 0 00100000:10000000:3.0:1788536016.101318:0:14302:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788536016.101478:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 770: rc = 0 00100000:10000000:3.0:1788536016.101691:0:14302:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788536016.101761:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 770: rc = 0 00100000:10000000:3.0:1788536016.102123:0:14302:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788536016.102167:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 770: rc = 0 00100000:10000000:3.0:1788536016.102764:0:14302:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788536016.102874:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 652: rc = 0 00100000:10000000:3.0:1788536016.103190:0:14302:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788536016.103323:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 652: rc = 0 00100000:10000000:3.0:1788536016.103603:0:14302:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788536016.103760:0:14302:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 652: rc = 0 00000020:00000080:3.0:1788536016.104160:0:14302:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788536016.104167:0:14302:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788536016.104176:0:14302:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d4969 00000020:01000004:3.0:1788536016.104183:0:14302:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788536016.104186:0:14302:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788536016.104191:0:14302:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a988040000 from MGS 00000020:01000004:3.0:1788536016.104193:0:14302:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788536016.104201:0:14302:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97a9ac7ab380) 00000020:00000080:3.0:1788536016.104208:0:14302:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788536016.104310:0:14302:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a988040000 from MGS, refs=2 00080000:01000000:3.0:1788536016.104314:0:14302:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788536016.104318:0:14302:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d4977 00000100:00100000:3.0:1788536016.104391:0:14302:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788536016.104557:0:14302:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788536016.104564:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788536016.105010:0:14302:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788536016.105016:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788536016.105469:0:14302:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788536016.105666:0:14302:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788536016.105672:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788536016.106171:0:14302:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788536016.106178:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788536016.106427:0:14302:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788536016.106434:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788536016.106990:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536016.106993:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536016.106995:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536016.107219:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536016.107227:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536016.107229:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536016.107921:0:14302:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788536016.109989:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788536016.119668:0:14302:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788536016.119686:0:14302:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788536016.119689:0:14302:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788536016.123875:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788536016.124143:0:14302:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788536016.124248:0:14302:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788536016.124739:0:14302:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788536016.125114:0:14302:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788536016.125299:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788536016.125305:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788536016.126087:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788536016.126095:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788536016.126578:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788536016.126584:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788536016.127564:0:14316:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788536016.127815:0:14302:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788536016.127843:0:14302:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.112@tcp' 00000020:01000004:1.0:1788536016.127845:0:14302:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788536016.127880:0:14302:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.112@tcp (typ=mgc) 00000020:00000080:1.0:1788536016.127932:0:14302:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.112@tcp (ffff97a9b67cb380) 00000020:00000080:1.0:1788536016.127949:0:14302:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788536016.128030:0:14302:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a988046000@MGC192.168.203.112@tcp: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788536016.128197:0:14302:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.112@tcp-0 is initialized 00000040:01000000:1.0:1788536016.128204:0:14302:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788536016.128755:0:14317:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788536016.128933:0:14302:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.112@tcp (uuid c49edad1-b206-4ca7-85f1-c4b27706521e) 00000020:00000080:3.0:1788536016.128953:0:14302:0:(genops.c:1385:class_connect()) connect: client c49edad1-b206-4ca7-85f1-c4b27706521e, cookie 0x74f51638375d4985 00000100:00080000:3.0:1788536016.128964:0:14302:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788536016.128970:0:14302:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import ffff97a988046000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788536016.129012:0:14302:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9bf769880 x1875415607101184/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788536016.129044:0:14302:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c49edad1-b206-4ca7-85f1-c4b27706521e->MGS 00000020:01000004:3.0:1788536016.129068:0:14302:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788536016.129074:0:14302:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788536016.129084:0:14302:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff97a9ac7a99c0) 00000020:00000080:3.0:1788536016.129094:0:14302:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788536016.129587:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c49edad1-b206-4ca7-85f1-c4b27706521e:3307:1875415607101184:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788536016.129659:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536016.130202:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607101184 00000100:00100000:1.0:1788536016.130209:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607101184 00000100:00100000:1.0:1788536016.130253:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788536016.130261:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1875415607101184:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788536016.130288:0:14313:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c49edad1-b206-4ca7-85f1-c4b27706521e@0@lo t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:1.0:1788536016.130310:0:14313:0:(genops.c:1385:class_connect()) connect: client c49edad1-b206-4ca7-85f1-c4b27706521e, cookie 0x74f51638375d4993 00000100:00080000:1.0:1788536016.130427:0:14313:0:(import.c:65:import_set_state_nolock()) ffff97a988045800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788536016.131016:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+5:3307:x1875415607101184:12345-0@lo:250:mount.lustre.0 Request processed in 753us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536016.131025:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788536016.131370:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788536016.131380:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:1.0:1788536016.131387:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788536016.131392:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788536016.131395:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a988046000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788536016.131398:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788536016.131405:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788536016.131411:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c49edad1-b206-4ca7-85f1-c4b27706521e:3307:1875415607101184:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788536016.140501:0:14302:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788536016.140719:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788536016.140726:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788536016.141354:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788536016.141362:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788536016.141690:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788536016.141699:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788536016.143383:0:14302:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788536016.143569:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788536016.143575:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788536016.144084:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788536016.144092:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788536016.176139:0:14302:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788536016.176345:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788536016.176353:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788536016.178590:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788536016.178603:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788536016.180100:0:14302:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788536016.180368:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788536016.180375:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788536016.181103:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788536016.181113:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788536016.181731:0:14302:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788536016.181938:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788536016.181949:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788536016.182497:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788536016.182504:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788536016.183358:0:14302:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788536016.183477:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788536016.183482:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788536016.184509:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788536016.184518:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788536016.207080:0:14302:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788536016.207335:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788536016.207340:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788536016.208566:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788536016.208578:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788536016.209408:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788536016.209417:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788536016.210712:0:14302:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788536016.210745:0:14302:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788536016.210752:0:14302:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788536016.211402:0:14302:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788536016.211465:0:14302:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788536016.211470:0:14302:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788536016.211473:0:14302:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788536016.211474:0:14302:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788536016.211475:0:14302:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788536016.211477:0:14302:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788536016.211478:0:14302:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788536016.211480:0:14302:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788536016.211481:0:14302:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788536016.211483:0:14302:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788536016.211485:0:14302:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788536016.211488:0:14302:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788536016.211490:0:14302:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788536016.211498:0:14302:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788536016.211500:0:14302:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788536016.211501:0:14302:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788536016.211502:0:14302:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788536016.211503:0:14302:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788536016.211504:0:14302:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788536016.211505:0:14302:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788536016.211506:0:14302:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788536016.211507:0:14302:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788536016.211547:0:14302:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788536016.211572:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607101312:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788536016.213288:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536016.213341:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99803e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788536016.213342:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607101312 00000100:00100000:3.0:1788536016.213366:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607101312 00000100:00100000:3.0:1788536016.213448:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788536016.213460:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+5:14302:x1875415607101312:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788536016.213561:0:14315:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788536016.213566:0:14315:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788536016.213569:0:14315:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788536016.214785:0:14336:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788536016.215611:0:14315:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788536016.217357:0:14337:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788536016.217364:0:14337:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788536016.217366:0:14337:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788536016.217385:0:14337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788536016.218087:0:14315:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788536016.218099:0:14315:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788536016.227649:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607101312:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788536016.227667:0:14302:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788536016.227670:0:14302:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788536016.227672:0:14302:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788536016.227673:0:14302:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788536016.227675:0:14302:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788536016.227676:0:14302:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788536016.227677:0:14302:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788536016.227679:0:14302:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788536016.227680:0:14302:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788536016.227682:0:14302:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788536016.227683:0:14302:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788536016.227705:0:14302:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a988040000 from lustre-MDT0000 10000000:01000000:2.0:1788536016.227734:0:14302:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788536016.227737:0:14302:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788536016.227741:0:14302:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97a9b67cb380 10000000:01000000:2.0:1788536016.227744:0:14302:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788536016.227752:0:14302:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97a9b67cb380 from 1 00000100:00100000:1.0:1788536016.227753:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+5:14302:x1875415607101312:12345-0@lo:253:mount.lustre.0 Request processed in 14152us (14327us total) trans 0 rc 0/0 10000000:01000000:2.0:1788536016.227754:0:14302:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:1.0:1788536016.227764:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788536016.227791:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51c00/0x74f51638375d499a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.227801:0:14302:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51c00/0x74f51638375d499a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.227810:0:14302:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51c00/0x74f51638375d499a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536016.227842:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607101440:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788536016.227875:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536016.227950:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985304f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788536016.227960:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607101440 00000100:00100000:0.0:1788536016.227967:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607101440 00000100:00100000:0.0:1788536016.227998:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788536016.228004:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+5:14302:x1875415607101440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536016.228013:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536016.228024:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a987eca600/0x74f51638375d49a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d499a expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536016.228041:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a987eca600/0x74f51638375d49a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d499a expref: 6 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536016.228048:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a987eca600/0x74f51638375d49a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d499a expref: 6 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536016.228063:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987eca600, rc 0) 00000100:00100000:0.0:1788536016.228092:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+6:14302:x1875415607101440:12345-0@lo:101:mount.lustre.0 Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536016.228098:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788536016.228113:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607101440:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788536016.228126:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51c00/0x74f51638375d499a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49a1 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.228134:0:14302:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51c00/0x74f51638375d499a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d49a1 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536016.228175:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607101568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536016.228201:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536016.228261:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607101568 00000100:00100000:1.0:1788536016.228265:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607101568 00000100:00100000:2.0:1788536016.228267:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985304f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788536016.228296:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788536016.228303:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+6:14302:x1875415607101568:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536016.228493:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+6:14302:x1875415607101568:12345-0@lo:501:mount.lustre.0 Request processed in 190us (290us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788536016.228499:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788536016.228513:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607101568:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788536016.228534:0:14302:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788536016.228549:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51c00/0x74f51638375d499a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49a1 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.228558:0:14302:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51c00/0x74f51638375d499a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49a1 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536016.228565:0:14302:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a988040000 10000000:01000000:2.0:1788536016.228569:0:14302:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788536016.228572:0:14302:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97a988040000 10000000:01000000:2.0:1788536016.228575:0:14302:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788536016.228578:0:14302:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97a988040000 from 1 10000000:01000000:2.0:1788536016.228586:0:14302:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788536016.228601:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51e00/0x74f51638375d49a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.228608:0:14302:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51e00/0x74f51638375d49a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.229434:0:14302:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51e00/0x74f51638375d49a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536016.229454:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607101696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788536016.229493:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536016.229731:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985304f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788536016.229778:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607101696 00000100:00100000:1.0:1788536016.229784:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607101696 00000100:00100000:1.0:1788536016.229827:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788536016.229836:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+6:14302:x1875415607101696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536016.229849:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536016.229865:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b6d0ae00/0x74f51638375d49af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d49a8 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536016.229903:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b6d0ae00/0x74f51638375d49af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d49a8 expref: 7 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536016.229927:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b6d0ae00/0x74f51638375d49af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d49a8 expref: 7 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536016.229935:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0ae00, rc 0) 00000100:00100000:1.0:1788536016.230100:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+7:14302:x1875415607101696:12345-0@lo:101:mount.lustre.0 Request processed in 264us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536016.230107:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788536016.230169:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607101696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788536016.230183:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51e00/0x74f51638375d49a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49af expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.230192:0:14302:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51e00/0x74f51638375d49a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d49af expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536016.230207:0:14302:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788536016.230262:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51e00/0x74f51638375d49a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49af expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.230270:0:14302:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51e00/0x74f51638375d49a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49af expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536016.230277:0:14302:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788536016.230281:0:14302:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788536016.230292:0:14302:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97a988040000 10000000:01000000:2.0:1788536016.230294:0:14302:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788536016.230298:0:14302:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788536016.230301:0:14302:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788536016.230324:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51400/0x74f51638375d49b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.230331:0:14302:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51400/0x74f51638375d49b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.230339:0:14302:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51400/0x74f51638375d49b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536016.230365:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607101824:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788536016.230403:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536016.230432:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985304f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788536016.230460:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607101824 00000100:00100000:3.0:1788536016.230466:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607101824 00000100:00100000:3.0:1788536016.230547:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788536016.230557:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+7:14302:x1875415607101824:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536016.230566:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536016.230580:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a980030600/0x74f51638375d49bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d49b6 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.230597:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980030600/0x74f51638375d49bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d49b6 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.230606:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a980030600/0x74f51638375d49bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d49b6 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.230613:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980030600, rc 0) 00000100:00100000:3.0:1788536016.230655:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+8:14302:x1875415607101824:12345-0@lo:101:mount.lustre.0 Request processed in 100us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536016.230661:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788536016.230729:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607101824:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788536016.230741:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51400/0x74f51638375d49b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49bd expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.230749:0:14302:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51400/0x74f51638375d49b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d49bd expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536016.230796:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607101952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536016.230821:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536016.230842:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985304f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788536016.230879:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607101952 00000100:00100000:0.0:1788536016.230928:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607101952 00000100:00100000:0.0:1788536016.230974:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788536016.230983:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+8:14302:x1875415607101952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536016.231647:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+9:14302:x1875415607101952:12345-0@lo:501:mount.lustre.0 Request processed in 664us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536016.231656:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788536016.231777:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607101952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536016.231816:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607102080:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536016.232096:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536016.232126:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985304f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788536016.232527:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607102080 00000100:00100000:3.0:1788536016.232535:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607102080 00000100:00100000:3.0:1788536016.232967:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788536016.232977:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+9:14302:x1875415607102080:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788536016.233339:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+9:14302:x1875415607102080:12345-0@lo:503:mount.lustre.0 Request processed in 363us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536016.233347:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788536016.233484:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607102080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536016.234271:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49edad1-b206-4ca7-85f1-c4b27706521e:14338:1875415607102208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788536016.234365:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536016.234406:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987f88900 going to sleep for 11 seconds 00000100:00100000:0.0:1788536016.234514:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607102208 00000100:00100000:0.0:1788536016.234521:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607102208 00000100:00100000:0.0:1788536016.234562:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788536016.234572:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+9:14338:x1875415607102208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788536016.234874:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+9:14338:x1875415607102208:12345-0@lo:502:llog_process_th.0 Request processed in 304us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536016.234882:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788536016.235317:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49edad1-b206-4ca7-85f1-c4b27706521e:14338:1875415607102208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788536016.235347:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536016.235358:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536016.235360:0:14338:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788536016.235366:0:14338:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788536016.235369:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788536016.235383:0:14338:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97a9b67c99c0) 00000020:00000080:1.0:1788536016.235399:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788536016.235405:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788536016.235472:0:14338:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788536016.235481:0:14338:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d49cb 00000020:00000080:1.0:1788536016.236555:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788536016.236562:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536016.236567:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536016.236569:0:14338:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788536016.236572:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536016.236577:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536016.236578:0:14338:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788536016.236582:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788536016.236592:0:14338:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97a9b67ccd40) 00000020:00000080:1.0:1788536016.236605:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788536016.236608:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788536016.236620:0:14338:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788536016.236623:0:14338:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788536016.236629:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788536016.236690:0:14338:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a988040000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788536016.236703:0:14338:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97a990fa4d40) 00000020:00000080:1.0:1788536016.236711:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788536016.236764:0:14338:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788536016.236770:0:14338:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74f51638375d49e0 00000020:00000080:1.0:1788536016.236862:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788536016.236868:0:14338:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788536016.236872:0:14338:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x74f51638375d49e7 00080000:01000000:1.0:1788536016.236878:0:14338:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788536016.236881:0:14338:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d49ee 00010000:00010000:0.0:1788536016.289575:0:14338:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788536016.290068:0:14338:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1788536016.290258:0:14338:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788536016.290994:0:14338:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97a9b91d3380) 00000020:00000080:0.0:1788536016.291013:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788536016.291097:0:14338:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788536016.291107:0:14338:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d49fc 00000020:00000080:3.0:1788536016.292179:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788536016.298782:0:14338:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x74f51638375d4a03 00000020:00000080:0.0:1788536016.302727:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788536016.302748:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788536016.302755:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536016.302757:0:14338:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788536016.302761:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788536016.302767:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536016.302769:0:14338:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788536016.302783:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788536016.302830:0:14338:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788536016.302846:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788536016.302855:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536016.302856:0:14338:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788536016.302859:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788536016.302861:0:14338:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:0.0:1788536016.302863:0:14338:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788536016.302864:0:14338:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788536016.302866:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788536016.302868:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536016.302869:0:14338:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788536016.302871:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788536016.302875:0:14338:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788536016.302878:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536016.302879:0:14338:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788536016.302883:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788536016.302922:0:14338:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:2.0:1788536016.303241:0:14338:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788536016.303246:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788536016.303262:0:14338:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97a9b713b380) 00000020:00000080:2.0:1788536016.303282:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788536016.303299:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788536016.303374:0:14338:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788536016.303382:0:14338:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788536016.303388:0:14338:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d4a11 00010000:00080000:2.0:1788536016.303434:0:14338:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a9bb3ea800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788536016.303647:0:14338:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788536016.304521:0:14338:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788536016.304587:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788536016.306817:0:14338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788536016.307226:0:14338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788536016.307470:0:14338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788536016.308002:0:14342:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788536016.308008:0:14342:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788536016.309488:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788536016.309505:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788536016.309542:0:14338:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788536016.309562:0:14338:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74f51638375d4a18 00000100:00080000:2.0:1788536016.309573:0:14338:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788536016.309579:0:14338:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97a9bb3ea800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788536016.309644:0:14338:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b740a680 x1875415607102336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788536016.309720:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607102336:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788536016.309860:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415607102336 offset 0 length 520: 4 00000100:00080000:2.0:1788536016.310027:0:14338:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788536016.313267:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536016.313297:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.313299:0:14338:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788536016.313304:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788536016.313306:0:14338:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788536016.313308:0:14338:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788536016.313309:0:14338:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788536016.313310:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788536016.313312:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.313314:0:14338:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788536016.313316:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788536016.313321:0:14338:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788536016.313324:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.313325:0:14338:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788536016.313327:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788536016.313331:0:14338:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:2.0:1788536016.313354:0:14338:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788536016.313357:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788536016.313370:0:14338:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97a9b71399c0) 00000020:00000080:2.0:1788536016.313389:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788536016.313393:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788536016.313463:0:14338:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788536016.313468:0:14338:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788536016.313474:0:14338:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74f51638375d4a26 00010000:00080000:2.0:1788536016.313505:0:14338:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a987bbc000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788536016.313737:0:14338:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788536016.314198:0:14338:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788536016.314223:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788536016.315242:0:14338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788536016.315399:0:14338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788536016.315464:0:14338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788536016.316514:0:14344:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788536016.316521:0:14344:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788536016.317187:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788536016.317206:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788536016.317242:0:14338:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788536016.317260:0:14338:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74f51638375d4a2d 00000100:00080000:2.0:1788536016.317271:0:14338:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788536016.317278:0:14338:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a987bbc000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788536016.317377:0:14338:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b7409880 x1875415607102464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788536016.317445:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607102464:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788536016.317500:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415607102464 offset 0 length 520: 4 00000100:00080000:2.0:1788536016.317555:0:14338:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788536016.317625:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536016.317630:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.317632:0:14338:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788536016.317635:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788536016.317640:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.317641:0:14338:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788536016.317644:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788536016.317646:0:14338:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788536016.317648:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536016.317650:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.317652:0:14338:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788536016.317654:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788536016.317657:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.317658:0:14338:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788536016.317662:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788536016.317691:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49edad1-b206-4ca7-85f1-c4b27706521e:14338:1875415607102592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788536016.317742:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536016.317760:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9853043c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788536016.317858:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607102592 00000100:00100000:3.0:1788536016.317865:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607102592 00000100:00100000:3.0:1788536016.318121:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788536016.318131:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+9:14338:x1875415607102592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788536016.318550:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+9:14338:x1875415607102592:12345-0@lo:502:llog_process_th.0 Request processed in 419us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536016.318559:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788536016.318642:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49edad1-b206-4ca7-85f1-c4b27706521e:14338:1875415607102592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788536016.318671:0:14338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536016.318676:0:14338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.318678:0:14338:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788536016.318687:0:14338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788536016.319153:0:14302:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788536016.319177:0:14302:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788536016.319229:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51400/0x74f51638375d49b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49bd expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536016.319241:0:14302:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51400/0x74f51638375d49b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49bd expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536016.319249:0:14302:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a988040000 from 1 10000000:01000000:1.0:1788536016.319252:0:14302:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788536016.319284:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536016.319316:0:14302:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536016.319326:0:14302:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536016.319347:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607102720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536016.319390:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536016.319426:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a998095480 going to sleep for 11 seconds 00000100:00100000:0.0:1788536016.319549:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607102720 00000100:00100000:0.0:1788536016.319558:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607102720 00000100:00100000:0.0:1788536016.319606:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788536016.319616:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+9:14302:x1875415607102720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536016.319628:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536016.319642:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a987eca000/0x74f51638375d4a3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4a34 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536016.319678:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a987eca000/0x74f51638375d4a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4a34 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536016.319689:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a987eca000/0x74f51638375d4a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4a34 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536016.319698:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987eca000, rc 0) 00000100:00100000:0.0:1788536016.319740:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+10:14302:x1875415607102720:12345-0@lo:101:mount.lustre.0 Request processed in 126us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536016.319747:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788536016.320113:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607102720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536016.320129:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a3b expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536016.320139:0:14302:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4a3b expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536016.320675:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607102848:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788536016.320719:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536016.320753:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a998095480 going to sleep for 11 seconds 00000100:00100000:3.0:1788536016.320927:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607102848 00000100:00100000:3.0:1788536016.320933:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607102848 00000100:00100000:3.0:1788536016.320968:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788536016.320975:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+10:14302:x1875415607102848:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788536016.320992:0:14315:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788536016.320998:0:14315:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788536016.321063:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+10:14302:x1875415607102848:12345-0@lo:256:mount.lustre.0 Request processed in 88us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536016.321070:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788536016.321181:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607102848:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788536016.321845:0:14302:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788536016.322096:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a3b expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536016.322108:0:14302:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a3b expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536016.322166:0:14302:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a988040000 from 1 10000000:01000000:1.0:1788536016.322170:0:14302:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788536016.322201:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536016.322209:0:14302:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536016.322217:0:14302:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536016.322233:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607102976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536016.322274:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536016.322443:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a998095480 going to sleep for 11 seconds 00000100:00100000:3.0:1788536016.322514:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607102976 00000100:00100000:3.0:1788536016.322520:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607102976 00000100:00100000:3.0:1788536016.322592:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788536016.322600:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+10:14302:x1875415607102976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536016.322612:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536016.322626:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a980031c00/0x74f51638375d4a49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4a42 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.322645:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980031c00/0x74f51638375d4a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4a42 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.322668:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a980031c00/0x74f51638375d4a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4a42 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.322676:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980031c00, rc 0) 00000100:00100000:3.0:1788536016.322761:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+11:14302:x1875415607102976:12345-0@lo:101:mount.lustre.0 Request processed in 162us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536016.322768:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788536016.322944:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607102976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536016.322956:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a49 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536016.322965:0:14302:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4a49 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536016.323018:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607103104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536016.323047:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536016.323062:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a998095480 going to sleep for 11 seconds 00000100:00100000:0.0:1788536016.323408:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607103104 00000100:00100000:0.0:1788536016.323414:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607103104 00000100:00100000:0.0:1788536016.323442:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788536016.323449:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+11:14302:x1875415607103104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536016.324239:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+11:14302:x1875415607103104:12345-0@lo:501:mount.lustre.0 Request processed in 788us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536016.324249:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788536016.324367:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607103104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536016.324406:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607103232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536016.324447:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536016.324516:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9853043c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788536016.324549:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607103232 00000100:00100000:1.0:1788536016.324554:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607103232 00000100:00100000:1.0:1788536016.324614:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788536016.324623:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+11:14302:x1875415607103232:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536016.324853:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607103232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536016.325179:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49edad1-b206-4ca7-85f1-c4b27706521e:14346:1875415607103360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788536016.325211:0:14346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536016.325253:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+11:14302:x1875415607103232:12345-0@lo:503:mount.lustre.0 Request processed in 148us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536016.325262:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788536016.325457:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985304180 going to sleep for 11 seconds 00000100:00100000:1.0:1788536016.325524:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607103360 00000100:00100000:1.0:1788536016.325529:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607103360 00000100:00100000:1.0:1788536016.325545:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788536016.325550:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986e9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+11:14346:x1875415607103360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788536016.325740:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986e9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+11:14346:x1875415607103360:12345-0@lo:502:llog_process_th.0 Request processed in 189us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536016.325747:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788536016.325884:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49edad1-b206-4ca7-85f1-c4b27706521e:14346:1875415607103360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788536016.325960:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788536016.325968:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.325971:0:14346:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788536016.325977:0:14346:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a988040000 00000020:00000080:2.0:1788536016.325979:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788536016.325986:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536016.325988:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.325989:0:14346:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788536016.325991:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788536016.325993:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.325995:0:14346:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788536016.325998:0:14346:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a988040000 00000020:00000080:2.0:1788536016.326000:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788536016.326057:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536016.326060:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.326061:0:14346:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788536016.326063:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788536016.326065:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.326067:0:14346:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788536016.326075:0:14346:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a988040000 00000020:00000080:2.0:1788536016.326077:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788536016.326108:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49edad1-b206-4ca7-85f1-c4b27706521e:14346:1875415607103488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788536016.326139:0:14346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536016.326151:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985304180 going to sleep for 11 seconds 00000100:00100000:3.0:1788536016.326929:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607103488 00000100:00100000:3.0:1788536016.326936:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607103488 00000100:00100000:3.0:1788536016.326970:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788536016.326977:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+11:14346:x1875415607103488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788536016.327147:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+11:14346:x1875415607103488:12345-0@lo:502:llog_process_th.0 Request processed in 170us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536016.327154:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788536016.331094:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49edad1-b206-4ca7-85f1-c4b27706521e:14346:1875415607103488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788536016.331142:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536016.331409:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536016.331413:0:14346:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788536016.331417:0:14346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788536016.331948:0:14302:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788536016.331971:0:14302:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788536016.331987:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a49 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.331999:0:14302:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a49 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536016.332042:0:14302:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788536016.332044:0:14302:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a988040000 10000000:01000000:2.0:1788536016.332047:0:14302:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a988040000 10000000:01000000:2.0:1788536016.332050:0:14302:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788536016.332056:0:14302:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a988040000 from 1 10000000:01000000:2.0:1788536016.332058:0:14302:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788536016.332102:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50200/0x74f51638375d4a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.332111:0:14302:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50200/0x74f51638375d4a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.332132:0:14302:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50200/0x74f51638375d4a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536016.332155:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607103616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788536016.332922:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536016.332963:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985304180 going to sleep for 11 seconds 00000100:00100000:3.0:1788536016.333059:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607103616 00000100:00100000:3.0:1788536016.333067:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607103616 00000100:00100000:3.0:1788536016.333157:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788536016.333167:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+11:14302:x1875415607103616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536016.333181:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536016.333196:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a980030800/0x74f51638375d4a57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4a50 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.333219:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980030800/0x74f51638375d4a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4a50 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.333231:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a980030800/0x74f51638375d4a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4a50 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.335439:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980030800, rc 0) 00000100:00100000:3.0:1788536016.335572:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14302:x1875415607103616:12345-0@lo:101:mount.lustre.0 Request processed in 2404us (2683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536016.335581:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788536016.347012:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607103616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788536016.347045:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50200/0x74f51638375d4a50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a57 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536016.347059:0:14302:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50200/0x74f51638375d4a50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4a57 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536016.347161:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607103744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536016.347225:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536016.347266:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985304180 going to sleep for 11 seconds 00000100:00100000:3.0:1788536016.348395:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607103744 00000100:00100000:3.0:1788536016.348405:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607103744 00000100:00100000:3.0:1788536016.348460:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788536016.348469:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14302:x1875415607103744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788536016.348726:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14302:x1875415607103744:12345-0@lo:501:mount.lustre.0 Request processed in 258us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536016.348734:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788536016.348823:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607103744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536016.348863:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607103872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536016.348947:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536016.348973:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985304180 going to sleep for 11 seconds 00000100:00100000:0.0:1788536016.350375:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607103872 00000100:00100000:0.0:1788536016.350388:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607103872 00000100:00100000:0.0:1788536016.350481:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788536016.350491:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14302:x1875415607103872:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788536016.350701:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14302:x1875415607103872:12345-0@lo:503:mount.lustre.0 Request processed in 211us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536016.350709:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788536016.355712:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607103872:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788536016.360572:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf768000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49edad1-b206-4ca7-85f1-c4b27706521e:14351:1875415607104000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788536016.360650:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536016.360694:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985529780 going to sleep for 11 seconds 00000100:00100000:1.0:1788536016.360741:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607104000 00000100:00100000:1.0:1788536016.360749:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607104000 00000100:00100000:1.0:1788536016.360806:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788536016.360817:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14351:x1875415607104000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788536016.361099:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14351:x1875415607104000:12345-0@lo:502:llog_process_th.0 Request processed in 283us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536016.361112:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788536016.361167:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf768000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49edad1-b206-4ca7-85f1-c4b27706521e:14351:1875415607104000:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788536016.361221:0:14351:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788536016.361234:0:14351:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97a990fa0000) 00000020:00000080:1.0:1788536016.361251:0:14351:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788536016.361556:0:14351:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a988040000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788536016.361566:0:14351:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a988040000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788536016.361569:0:14351:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a988040000 4 00010000:00080000:1.0:1788536016.361598:0:14351:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a9bb3ea000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788536016.367380:0:14351:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788536016.367601:0:14351:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788536016.367642:0:14351:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788536016.367654:0:14351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x74f51638375d4a65 00000100:00080000:1.0:1788536016.367665:0:14351:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788536016.367670:0:14351:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97a9bb3ea000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788536016.367705:0:14351:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b7414000 x1875415607104128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788536016.367778:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875415607104128:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788536016.367849:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536016.368075:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607104128 00000100:00100000:2.0:1788536016.368083:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607104128 00000100:00100000:2.0:1788536016.368111:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788536016.368119:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875415607104128:12345-0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788536016.368205:0:14351:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788536016.373810:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7416300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49edad1-b206-4ca7-85f1-c4b27706521e:14351:1875415607104256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788536016.373904:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536016.373961:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607104256 00000100:00100000:1.0:1788536016.373970:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607104256 00000100:00100000:1.0:1788536016.374008:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788536016.374017:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14351:x1875415607104256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788536016.374261:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14351:x1875415607104256:12345-0@lo:502:llog_process_th.0 Request processed in 243us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536016.374268:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788536016.374372:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99cbd0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788536016.374397:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7416300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c49edad1-b206-4ca7-85f1-c4b27706521e:14351:1875415607104256:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788536016.374424:0:14351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788536016.374476:0:14302:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788536016.374498:0:14302:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788536016.374521:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50200/0x74f51638375d4a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a57 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536016.374540:0:14302:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50200/0x74f51638375d4a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a57 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788536016.374592:0:14302:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788536016.374594:0:14302:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788536016.374596:0:14302:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788536016.374597:0:14302:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788536016.374598:0:14302:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788536016.374600:0:14302:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788536016.374601:0:14302:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788536016.374603:0:14302:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788536016.374605:0:14302:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788536016.374606:0:14302:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788536016.374610:0:14302:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788536016.374613:0:14302:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788536016.374614:0:14302:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788536016.374615:0:14302:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788536016.374617:0:14302:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788536016.374618:0:14302:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788536016.374619:0:14302:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788536016.374620:0:14302:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788536016.374621:0:14302:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788536016.374622:0:14302:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788536016.374623:0:14302:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788536016.374637:0:14302:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788536016.374647:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607104384:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788536016.374678:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536016.374699:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b6c14600 going to sleep for 11 seconds 00000100:00100000:3.0:1788536016.375104:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607104384 00000100:00100000:3.0:1788536016.375110:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607104384 00000100:00100000:3.0:1788536016.375151:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788536016.375160:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14302:x1875415607104384:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788536016.375183:0:14314:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788536016.375199:0:14314:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788536016.375600:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875415607104128:12345-0@lo:38:llog_process_th.0 Request processed in 7479us (7748us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788536016.375611:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788536016.388156:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788536016.388171:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a9bb3ea000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788536016.388178:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788536016.388191:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875415607104128:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1788536016.442642:0:14314:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788536016.442660:0:14314:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788536016.442817:0:14336:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788536016.442824:0:14336:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788536016.442847:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.442867:0:14336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a987eca000/0x74f51638375d4a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4a34 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.442876:0:14336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.443075:0:14336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a987eca000/0x74f51638375d4a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d4a34 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.443092:0:14336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a987eca000/0x74f51638375d4a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d4a34 expref: 12 pid: 14313 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536016.443108:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14336:1875415607104512:0@lo:104: 00000100:00100000:3.0:1788536016.443377:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536016.443420:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a985529b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788536016.443445:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607104512 00000100:00100000:1.0:1788536016.443454:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607104512 00000100:00100000:1.0:1788536016.443503:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788536016.443515:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+3:14336:x1875415607104512:12345-0@lo:104: 00010000:00010000:1.0:1788536016.443532:0:14303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4a3b expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536016.443600:0:14303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788536016.443608:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+3:14336:x1875415607104512:12345-0@lo:104: Request processed in 95us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536016.443614:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14336:1875415607104512:0@lo:104: 00000100:00100000:1.0:1788536016.443624:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788536016.443643:0:14336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.443663:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788536016.443669:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4a3b expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.443698:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ba00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:3.0:1788536016.443701:0:14309:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d4a3b expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.443710:0:14309:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d4a3b expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788536016.443717:0:14309:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d4a3b expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788536016.443722:0:14309:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788536016.443752:0:14309:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4a3b expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.443759:0:14309:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788536016.444060:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4a3b expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.444068:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0ba00/0x74f51638375d4a34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4a3b expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.444085:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536016.444087:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536016.444089:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536016.444204:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788536016.444218:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49edad1-b206-4ca7-85f1-c4b27706521e:3311:1875415607104640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788536016.444261:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536016.444466:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607104640 00000100:00100000:3.0:1788536016.444471:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607104640 00010000:00010000:3.0:1788536016.444491:0:14305:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a987eca000/0x74f51638375d4a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4a34 expref: 13 pid: 14313 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536016.444523:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788536016.444537:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+13:3311:x1875415607104640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788536016.444607:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536016.444613:0:14305:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a987eca000/0x74f51638375d4a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4a34 expref: 13 pid: 14313 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.444624:0:14305:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a987eca000/0x74f51638375d4a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d4a34 expref: 13 pid: 14313 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.444636:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a987eca000/0x74f51638375d4a3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d4a34 expref: 13 pid: 14313 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.444648:0:14305:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.444657:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788536016.444730:0:14305:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001847706s 00010000:00010000:3.0:1788536016.444736:0:14305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.444742:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.444749:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.444756:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.444762:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980031400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788536016.444867:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.444875:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.444926:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.444940:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536016.445162:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+12:3311:x1875415607104640:12345-0@lo:103:ldlm_bl.0 Request processed in 624us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536016.445169:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788536016.445195:0:14336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.445202:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536016.445209:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980031400/0x74f51638375d4a6c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536016.448180:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49edad1-b206-4ca7-85f1-c4b27706521e:3311:1875415607104640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788536016.460710:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+11:14302:x1875415607104384:12345-0@lo:253:mount.lustre.0 Request processed in 85541us (86020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536016.460723:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788536016.463081:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:14302:1875415607104384:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788536016.463100:0:14302:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788536016.463103:0:14302:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788536016.463105:0:14302:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788536016.463107:0:14302:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788536016.463108:0:14302:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788536016.463110:0:14302:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788536016.463111:0:14302:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788536016.463112:0:14302:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788536016.463114:0:14302:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788536016.463115:0:14302:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788536016.463117:0:14302:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788536016.463135:0:14302:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788536016.472368:0:14302:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788536016.473016:0:14302:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788536016.473306:0:14302:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788536016.473470:0:14302:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788536016.473734:0:14302:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788536016.477151:0:14302:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788536016.478703:0:14302:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788536016.479066:0:14302:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788536016.479345:0:14302:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788536016.482127:0:14302:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788536016.484965:0:14302:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788536016.485172:0:14302:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788536016.565417:0:14302:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788536016.565881:0:14302:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788536016.565943:0:14358:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788536016.565948:0:14358:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788536016.567132:0:14359:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788536016.567226:0:14359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788536016.570552:0:14302:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788536016.570747:0:14302:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788536016.572125:0:14359:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788536016.572202:0:14359:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788536016.572206:0:14359:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:1.0:1788536016.573758:0:14302:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788536016.573856:0:14302:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788536016.574424:0:14302:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788536016.575971:0:14302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788536016.577606:0:14302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788536016.577666:0:14302:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788536016.579623:0:14302:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788536016.584426:0:14302:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788536016.641609:0:14302:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788536016.641656:0:14302:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb59a418f7988 00100000:10000000:2.0:1788536016.641666:0:14302:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788536016.642259:0:14302:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788536016.642276:0:14302:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788536016.642294:0:14302:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788536016.642319:0:14302:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788536017.166481:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788536017.422971:0:14353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788536017.868966:0:14317:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788536017.868974:0:14317:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a988040000 from 6 10000000:01000000:2.0:1788536017.868979:0:14317:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788536017.869023:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536017.869057:0:14317:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536017.869070:0:14317:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536017.869096:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607104768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788536017.869160:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536017.869223:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987963540 going to sleep for 11 seconds 00000100:00100000:3.0:1788536017.869359:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607104768 00000100:00100000:3.0:1788536017.869376:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607104768 00000100:00100000:3.0:1788536017.869428:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788536017.869439:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+11:14317:x1875415607104768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788536017.869452:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536017.869467:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a980031400/0x74f51638375d4a7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4a73 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536017.869493:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980031400/0x74f51638375d4a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4a73 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536017.869505:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a980031400/0x74f51638375d4a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4a73 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536017.869514:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980031400, rc 0) 00000100:00100000:3.0:1788536017.869569:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14317:x1875415607104768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536017.869583:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788536017.869741:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607104768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788536017.869756:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a7a expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536017.869778:0:14317:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4a7a expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536017.869841:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607104896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788536017.869873:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536017.869930:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987963540 going to sleep for 11 seconds 00000100:00100000:3.0:1788536017.870092:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607104896 00000100:00100000:3.0:1788536017.870097:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607104896 00000100:00100000:3.0:1788536017.870131:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788536017.870139:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14317:x1875415607104896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788536017.870154:0:14314:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788536017.870170:0:14314:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788536017.870174:0:14314:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788536017.870269:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14317:x1875415607104896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536017.870276:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788536017.870308:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607104896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788536017.870355:0:14317:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788536017.870361:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a7a expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536017.870383:0:14317:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a7a expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536018.189464:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788536018.446507:0:14353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788536019.215295:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536020.237408:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788536020.687710:0:14602:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788536021.261098:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788536021.773078:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536021.773086:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788536021.773089:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536021.773092:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788536021.773095:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788536021.773099:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788536021.773103:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a9bb3ea000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788536021.773393:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788536021.773417:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49edad1-b206-4ca7-85f1-c4b27706521e:3310:1875415607105024:0@lo:400:kworker.0 00000100:00100000:2.0:1788536021.773486:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788536021.773592:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97a9bb3ea000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788536021.773614:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b7415c00 x1875415607105152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788536021.773681:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875415607105152:0@lo:38:kworker.0 00000100:00100000:2.0:1788536021.773717:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536021.773968:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607105024 00000100:00100000:3.0:1788536021.773978:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607105024 00000100:00100000:1.0:1788536021.774405:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607105152 00000100:00100000:1.0:1788536021.774422:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607105152 00000100:00100000:1.0:1788536021.774470:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788536021.774478:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875415607105152:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788536021.774519:0:14322:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:1.0:1788536021.774559:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x74f51638375d4a81 00000004:00100000:1.0:1788536021.774574:0:14322:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788536021.774712:0:14322:0:(import.c:65:import_set_state_nolock()) ffff97a987b6c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788536021.774771:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875415607105152:12345-0@lo:38:kworker.0 Request processed in 292us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536021.774778:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788536021.774835:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a9b7415c00 x1875415607105152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788536031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536021.776773:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788536021.776789:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:3310:x1875415607105024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536021.776909:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:3310:x1875415607105024:12345-0@lo:400:kworker.0 Request processed in 124us (3421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536021.776930:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788536021.777013:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49edad1-b206-4ca7-85f1-c4b27706521e:3310:1875415607105024:0@lo:400:kworker.0 00000100:00080000:1.0:1788536021.777418:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788536021.777430:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788536021.777435:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788536021.777439:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a9bb3ea000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788536021.777448:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875415607105152:0@lo:38:kworker.0 00010000:00010000:2.0:1788536022.286253:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536023.311402:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788536023.438988:0:14753:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0d89cc60 20000000:00000080:3.0:1788536023.439006:0:14753:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a9b7d6a800 uarg=0000000000000000 20000000:01000000:3.0:1788536023.439050:0:14753:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788536023.439058:0:14753:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788536023.439063:0:14753:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788536023.449056:0:14754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788536023.449497:0:14753:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788536023.475581:0:14753:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788536023.475755:0:14753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536023.475775:0:14753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a980031c00/0x74f51638375d4a49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4a42 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536023.475784:0:14753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536023.475829:0:14753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a980031c00/0x74f51638375d4a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d4a42 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536023.475846:0:14753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a980031c00/0x74f51638375d4a49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d4a42 expref: 11 pid: 14314 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536023.475871:0:14753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14753:1875415607105280:0@lo:104: 00000100:00100000:0.0:1788536023.475961:0:14753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536023.476015:0:14753:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99037a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788536023.478060:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607105280 00000100:00100000:1.0:1788536023.478074:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607105280 00000100:00100000:1.0:1788536023.478157:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788536023.478169:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+3:14753:x1875415607105280:12345-0@lo:104: 00010000:00010000:1.0:1788536023.478187:0:14303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4a49 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536023.478269:0:14303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788536023.478277:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+3:14753:x1875415607105280:12345-0@lo:104: Request processed in 111us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536023.478298:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788536023.478508:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536023.478517:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4a49 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.478525:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b400 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:2.0:1788536023.478530:0:14309:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d4a49 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.478538:0:14309:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d4a49 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788536023.478544:0:14309:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d4a49 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536023.478550:0:14309:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788536023.478596:0:14309:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4a49 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.478602:0:14309:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788536023.478625:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4a49 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.478632:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b400/0x74f51638375d4a42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4a49 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.478655:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536023.478657:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536023.478659:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536023.478687:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49edad1-b206-4ca7-85f1-c4b27706521e:3308:1875415607105408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788536023.478734:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536023.478811:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607105408 00000100:00100000:2.0:1788536023.478816:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607105408 00010000:00010000:2.0:1788536023.478836:0:14306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a980031c00/0x74f51638375d4a49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4a42 expref: 12 pid: 14314 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536023.478869:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788536023.478877:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:3308:x1875415607105408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788536023.478924:0:14306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788536023.478932:0:14306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a980031c00/0x74f51638375d4a49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4a42 expref: 12 pid: 14314 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.478942:0:14306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a980031c00/0x74f51638375d4a49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d4a42 expref: 12 pid: 14314 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.478959:0:14306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.478967:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.478981:0:14306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.478988:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.478995:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.479002:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.479013:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb000 already unused, calling callback (ffffffffc1455530) 00010000:00010000:2.0:1788536023.479017:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.479024:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.479043:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536023.479054:0:14306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788536023.479084:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:3308:x1875415607105408:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536023.479091:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788536023.479127:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49edad1-b206-4ca7-85f1-c4b27706521e:3308:1875415607105408:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788536023.479129:0:14753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980031c00/0x74f51638375d4a49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d4a42 expref: 11 pid: 14314 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536023.479151:0:14753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14753:1875415607105280:0@lo:104: 00010000:00010000:0.0:1788536023.479164:0:14753:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536023.479172:0:14753:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536023.479178:0:14753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536023.479192:0:14753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a987ecb000/0x74f51638375d4a88 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536024.333054:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788536024.973949:0:14317:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788536024.973958:0:14317:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a988040000 from 10 10000000:01000000:1.0:1788536024.973963:0:14317:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788536024.974017:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536024.974030:0:14317:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536024.974043:0:14317:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536024.974070:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607105536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788536024.974148:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536024.974192:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986cc1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788536024.975336:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607105536 00000100:00100000:0.0:1788536024.975349:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607105536 00000100:00100000:0.0:1788536024.975412:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788536024.975422:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+11:14317:x1875415607105536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788536024.975435:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536024.975450:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a987ecb200/0x74f51638375d4a96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4a8f expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536024.975474:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a987ecb200/0x74f51638375d4a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4a8f expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536024.975485:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a987ecb200/0x74f51638375d4a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4a8f expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536024.975494:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987ecb200, rc 0) 00000100:00100000:0.0:1788536024.975549:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14317:x1875415607105536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536024.975555:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788536024.982981:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607105536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788536024.983009:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a96 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536024.983022:0:14317:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4a96 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536024.983095:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607105664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788536024.983164:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536024.983200:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98a7acd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788536024.983223:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607105664 00000100:00100000:2.0:1788536024.983230:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607105664 00000100:00100000:2.0:1788536024.983283:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788536024.983291:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14317:x1875415607105664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788536024.983522:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14317:x1875415607105664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536024.983531:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788536024.983571:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607105664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788536024.983598:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607105792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788536024.983633:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536024.983646:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b7384f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788536024.984313:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607105792 00000100:00100000:1.0:1788536024.984319:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607105792 00000100:00100000:1.0:1788536024.984354:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788536024.984361:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14317:x1875415607105792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788536024.984534:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:14317:x1875415607105792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536024.984541:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788536024.986388:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607105792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788536024.987641:0:14821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788536024.990581:0:14317:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788536024.990622:0:14317:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788536024.990635:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a96 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536024.990647:0:14317:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4a96 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536025.360424:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536026.382930:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788536026.893813:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536016/real 1788536016] req@ffff97a9b7409880 x1875415607102464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536026 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536026.893856:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a9b7409880 x1875415607102464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536026 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536026.893928:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536016/real 1788536016] req@ffff97a9b740a680 x1875415607102336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536026 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536026.893939:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a9b740a680 x1875415607102336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536026 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788536026.893956:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a987bbc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788536026.893963:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788536026.893967:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607102464:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788536026.893973:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a9bb3ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788536026.893977:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788536026.893980:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607102336:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788536026.894047:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536026.894052:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788536026.894054:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a9bb3ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788536026.894058:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 418 00000100:00080000:1.0:1788536026.894063:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788536026.894069:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97a9bb3ea800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788536026.894088:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b7416a00 x1875415607106048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788536026.894117:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536026.894120:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788536026.894122:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a987bbc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788536026.894125:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 418 00000100:00080000:1.0:1788536026.894128:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788536026.894132:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a987bbc000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788536026.894144:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b7415180 x1875415607106176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788536026.894186:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49edad1-b206-4ca7-85f1-c4b27706521e:3309:1875415607105920:0@lo:400:kworker.0 00000100:00100000:1.0:1788536026.894243:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536026.894293:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607106304:0@lo:400:kworker.0 00000100:00100000:1.0:1788536026.894316:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536026.894343:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607105920 00000100:00100000:1.0:1788536026.894349:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607105920 00000100:00100000:1.0:1788536026.894384:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788536026.894392:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+12:3309:x1875415607105920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536026.894430:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+12:3309:x1875415607105920:12345-0@lo:400:kworker.0 Request processed in 38us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536026.894436:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788536026.894486:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49edad1-b206-4ca7-85f1-c4b27706521e:3309:1875415607105920:0@lo:400:kworker.0 00000100:00100000:1.0:1788536026.894502:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607106048:0@lo:8:kworker.0 00000400:00000100:1.0:1788536026.894521:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415607106048 offset 0 length 520: 4 00000100:00100000:1.0:1788536026.894533:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607106176:0@lo:8:kworker.0 00000400:00000100:1.0:1788536026.894557:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415607106176 offset 0 length 520: 4 00000100:00100000:0.0:1788536026.894734:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607106304 00000100:00100000:0.0:1788536026.894740:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607106304 00000100:00100000:0.0:1788536026.894772:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788536026.894779:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607106304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536026.894821:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607106304:12345-0@lo:400:kworker.0 Request processed in 43us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536026.894828:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788536026.895858:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a9b7415c00 x1875415607106304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536026.895872:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607106304:0@lo:400:kworker.0 00010000:00010000:1.0:1788536027.405108:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788536028.211458:0:15001:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788536028.211462:0:15001:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788536028.211569:0:15001:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a98601c800 00000020:01000004:2.0:1788536028.211583:0:15001:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788536028.211595:0:15001:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788536028.211608:0:15001:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97a9b713cd40) 00000020:00000080:2.0:1788536028.211622:0:15001:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788536028.227649:0:15001:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788536028.228026:0:15001:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788536028.229007:0:15001:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788536028.229305:0:15001:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788536028.229505:0:15001:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788536028.230001:0:15001:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 519: rc = 0 00100000:10000000:2.0:1788536028.230170:0:15001:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 519: rc = 0 00100000:10000000:2.0:1788536028.230325:0:15001:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 519: rc = 0 00100000:10000000:2.0:1788536028.231665:0:15001:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:2.0:1788536028.232121:0:15001:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:2.0:1788536028.232465:0:15001:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 641: rc = 0 00100000:10000000:2.0:1788536028.232704:0:15001:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:2.0:1788536028.233392:0:15001:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 641: rc = 0 00100000:10000000:2.0:1788536028.233614:0:15001:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 641: rc = 0 00000020:00000080:2.0:1788536028.238610:0:15001:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788536028.238624:0:15001:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788536028.238633:0:15001:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x74f51638375d4aa4 00000020:01000004:2.0:1788536028.238642:0:15001:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788536028.238662:0:15001:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788536028.238667:0:15001:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788536028.238673:0:15001:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788536028.238677:0:15001:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788536028.238689:0:15001:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97a9b7138000) 00000020:00000080:2.0:1788536028.238699:0:15001:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788536028.244231:0:15001:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788536028.244420:0:15001:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788536028.244427:0:15001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788536028.245264:0:15001:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788536028.245274:0:15001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788536028.245879:0:15001:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788536028.246128:0:15001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788536028.248720:0:15001:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788536028.249390:0:15001:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788536028.249398:0:15001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788536028.250378:0:15001:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788536028.250387:0:15001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788536028.274314:0:15001:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788536028.274685:0:15001:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788536028.274693:0:15001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788536028.279001:0:15001:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788536028.279020:0:15001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788536028.281226:0:15001:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788536028.281240:0:15001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788536028.286257:0:15001:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788536028.286618:0:15001:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788536028.286625:0:15001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788536028.287381:0:15001:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788536028.287561:0:15001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788536028.334000:0:15001:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788536028.334395:0:15001:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788536028.334403:0:15001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788536028.342362:0:15001:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788536028.342381:0:15001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788536028.343493:0:15001:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788536028.343516:0:15001:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788536028.343524:0:15001:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788536028.368244:0:15001:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788536028.368282:0:15001:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788536028.368286:0:15001:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788536028.368288:0:15001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788536028.368290:0:15001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788536028.368291:0:15001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788536028.368354:0:15001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788536028.368356:0:15001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788536028.368358:0:15001:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788536028.368360:0:15001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788536028.368361:0:15001:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788536028.368364:0:15001:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788536028.368367:0:15001:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788536028.368369:0:15001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788536028.368370:0:15001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788536028.368371:0:15001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788536028.368372:0:15001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788536028.368373:0:15001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788536028.368380:0:15001:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788536028.368381:0:15001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788536028.368382:0:15001:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788536028.368418:0:15001:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788536028.368438:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607106432:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788536028.368507:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536028.368668:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b6c14f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788536028.368984:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607106432 00000100:00100000:2.0:1788536028.368998:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607106432 00000100:00100000:2.0:1788536028.369135:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788536028.369153:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+12:15001:x1875415607106432:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788536028.369191:0:14315:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788536028.369194:0:14315:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788536028.369198:0:14315:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788536028.379525:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+12:15001:x1875415607106432:12345-0@lo:253:mount.lustre.0 Request processed in 10366us (11010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536028.379538:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788536028.379799:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607106432:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788536028.379816:0:15001:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788536028.379819:0:15001:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788536028.379820:0:15001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788536028.379822:0:15001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788536028.379823:0:15001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788536028.379833:0:15001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788536028.379834:0:15001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788536028.379836:0:15001:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788536028.379838:0:15001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788536028.379839:0:15001:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788536028.379860:0:15001:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a98601c800 from lustre-OST0000 10000000:01000000:1.0:1788536028.379885:0:15001:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788536028.381125:0:15001:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788536028.381134:0:15001:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97a9b67cb380 local copy 00010000:00010000:1.0:1788536028.381204:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51c00/0x74f51638375d499a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49a1 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536028.381674:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607106560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536028.381880:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536028.382199:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788536028.382246:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607106560 00000100:00100000:2.0:1788536028.382254:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607106560 00000100:00100000:2.0:1788536028.382433:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788536028.382444:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:15001:x1875415607106560:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536028.382645:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+12:15001:x1875415607106560:12345-0@lo:501:mount.lustre.0 Request processed in 202us (763us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788536028.382653:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788536028.382744:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607106560:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788536028.382762:0:15001:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788536028.382946:0:15001:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788536028.382953:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51c00/0x74f51638375d499a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49a1 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536028.382964:0:15001:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51c00/0x74f51638375d499a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49a1 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788536028.382998:0:15001:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a98601c800 10000000:01000000:3.0:1788536028.383003:0:15001:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788536028.383007:0:15001:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97a9b67cb380 10000000:01000000:3.0:1788536028.383010:0:15001:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788536028.383014:0:15001:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff97a9b67cb380 from 1 10000000:01000000:3.0:1788536028.383017:0:15001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788536028.383054:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980030400/0x74f51638375d4ab2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536028.383062:0:15001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a980030400/0x74f51638375d4ab2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536028.383072:0:15001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a980030400/0x74f51638375d4ab2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536028.383087:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607106688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788536028.383115:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536028.383775:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99803e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788536028.384005:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607106688 00000100:00100000:1.0:1788536028.384014:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607106688 00000100:00100000:1.0:1788536028.384106:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788536028.384115:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+12:15001:x1875415607106688:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536028.384212:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536028.384229:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b6d0a000/0x74f51638375d4ab9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4ab2 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536028.384252:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b6d0a000/0x74f51638375d4ab9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4ab2 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536028.384263:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b6d0a000/0x74f51638375d4ab9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4ab2 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536028.384272:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a000, rc 0) 00000100:00100000:1.0:1788536028.384334:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+13:15001:x1875415607106688:12345-0@lo:101:mount.lustre.0 Request processed in 220us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536028.384340:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788536028.384522:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607106688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536028.384537:0:15001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a980030400/0x74f51638375d4ab2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4ab9 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536028.384556:0:15001:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a980030400/0x74f51638375d4ab2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4ab9 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788536028.384576:0:15001:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788536028.384591:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980030400/0x74f51638375d4ab2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4ab9 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536028.384610:0:15001:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a980030400/0x74f51638375d4ab2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4ab9 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788536028.384617:0:15001:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788536028.384621:0:15001:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788536028.384627:0:15001:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788536028.384629:0:15001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788536028.384650:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980031200/0x74f51638375d4ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536028.384657:0:15001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a980031200/0x74f51638375d4ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536028.384665:0:15001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a980031200/0x74f51638375d4ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536028.384691:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607106816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788536028.384718:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536028.384748:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99803e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788536028.384961:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607106816 00000100:00100000:2.0:1788536028.384966:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607106816 00000100:00100000:2.0:1788536028.384990:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788536028.384997:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+13:15001:x1875415607106816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788536028.385005:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536028.385016:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9bfc50e00/0x74f51638375d4ac7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4ac0 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.385031:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9bfc50e00/0x74f51638375d4ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4ac0 expref: 14 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.385050:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9bfc50e00/0x74f51638375d4ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4ac0 expref: 14 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.385057:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc50e00, rc 0) 00000100:00100000:2.0:1788536028.385093:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+14:15001:x1875415607106816:12345-0@lo:101:mount.lustre.0 Request processed in 97us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536028.385106:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788536028.385440:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607106816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536028.385452:0:15001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a980031200/0x74f51638375d4ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4ac7 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536028.385460:0:15001:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a980031200/0x74f51638375d4ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4ac7 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788536028.386583:0:15001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788536028.388237:0:15001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788536028.388819:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788536028.388873:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788536028.388950:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788536028.389001:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788536028.389216:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788536028.389260:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788536028.389557:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788536028.389566:0:15001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788536028.389651:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607106944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788536028.389728:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536028.389852:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860c0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788536028.390136:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607106944 00000100:00100000:1.0:1788536028.390152:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607106944 00000100:00100000:1.0:1788536028.390198:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788536028.390208:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+14:15001:x1875415607106944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536028.391115:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+14:15001:x1875415607106944:12345-0@lo:501:mount.lustre.0 Request processed in 906us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536028.391125:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788536028.391366:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607106944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788536028.391411:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788536028.391455:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536028.391488:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860c0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788536028.391687:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607107072 00000100:00100000:0.0:1788536028.391693:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607107072 00000100:00100000:0.0:1788536028.391726:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788536028.391741:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+14:15001:x1875415607107072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788536028.392110:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+14:15001:x1875415607107072:12345-0@lo:503:mount.lustre.0 Request processed in 376us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536028.392119:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788536028.392571:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107072:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788536028.394030:0:15001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788536028.394424:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788536028.394493:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536028.394584:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860c0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788536028.394871:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607107200 00000100:00100000:2.0:1788536028.394879:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607107200 00000100:00100000:1.0:1788536028.394969:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788536028.394981:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+14:15001:x1875415607107200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788536028.395570:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+14:15001:x1875415607107200:12345-0@lo:502:mount.lustre.0 Request processed in 590us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536028.395578:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788536028.395983:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536028.396418:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788536028.396466:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788536028.396493:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788536028.396620:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788536028.396658:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788536028.396875:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788536028.397001:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788536028.397034:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788536028.397128:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788536028.397245:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788536028.397276:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788536028.397420:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788536028.397463:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536028.397521:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536028.397651:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788536028.397820:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607107328 00000100:00100000:3.0:1788536028.397838:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607107328 00000100:00100000:3.0:1788536028.397949:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788536028.397958:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+14:15001:x1875415607107328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788536028.398443:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+14:15001:x1875415607107328:12345-0@lo:502:mount.lustre.0 Request processed in 484us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536028.398451:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788536028.398534:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536028.398627:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788536028.398638:0:15001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788536028.399978:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788536028.399989:0:15015:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788536028.399996:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536028.399998:0:15015:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788536028.400004:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788536028.400019:0:15015:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97a990fa3380) 00000020:00000080:1.0:1788536028.400049:0:15015:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788536028.400056:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788536028.400130:0:15015:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a98601c800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788536028.400148:0:15015:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788536028.400157:0:15015:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x74f51638375d4ad5 00010000:00010000:0.0:1788536028.406368:0:15015:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788536028.406858:0:15015:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788536028.408684:0:15015:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788536028.410306:0:15015:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788536028.410318:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536028.410324:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536028.410326:0:15015:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788536028.410329:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788536028.410331:0:15015:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788536028.410333:0:15015:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788536028.410334:0:15015:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788536028.410336:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788536028.410338:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536028.410340:0:15015:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788536028.410342:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788536028.410345:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536028.410347:0:15015:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788536028.410350:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788536028.410352:0:15015:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788536028.410354:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536028.410356:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536028.410357:0:15015:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788536028.410359:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788536028.410361:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536028.410362:0:15015:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788536028.410366:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788536028.410426:0:15015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536028.410430:0:15015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536028.410431:0:15015:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788536028.410435:0:15015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788536028.412581:0:15001:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788536028.412623:0:15001:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788536028.412648:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980031200/0x74f51638375d4ac0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4ac7 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536028.412661:0:15001:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a980031200/0x74f51638375d4ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4ac7 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536028.412679:0:15001:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a98601c800 from 1 10000000:01000000:1.0:1788536028.412681:0:15001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788536028.412716:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536028.412725:0:15001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536028.412747:0:15001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536028.412773:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536028.412846:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536028.412909:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788536028.413037:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607107456 00000100:00100000:2.0:1788536028.413045:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607107456 00000100:00100000:2.0:1788536028.413087:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788536028.413102:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+14:15001:x1875415607107456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788536028.413116:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536028.413127:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9bfc51200/0x74f51638375d4ae3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4adc expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.413150:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9bfc51200/0x74f51638375d4ae3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4adc expref: 15 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.413160:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9bfc51200/0x74f51638375d4ae3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4adc expref: 15 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.413168:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc51200, rc 0) 00000100:00100000:2.0:1788536028.413213:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+15:15001:x1875415607107456:12345-0@lo:101:mount.lustre.0 Request processed in 112us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536028.413219:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788536028.413345:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536028.413359:0:15001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4ae3 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536028.413368:0:15001:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4ae3 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788536028.414105:0:15001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788536028.414503:0:15001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788536028.414714:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788536028.415067:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788536028.415133:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788536028.415142:0:15001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788536028.415210:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536028.415275:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536028.418930:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788536028.419111:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607107584 00000100:00100000:0.0:1788536028.419119:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607107584 00000100:00100000:0.0:1788536028.419163:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788536028.419173:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+15:15001:x1875415607107584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536028.419435:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+15:15001:x1875415607107584:12345-0@lo:501:mount.lustre.0 Request processed in 263us (4158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536028.419443:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788536028.419587:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536028.419634:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536028.419677:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536028.419702:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788536028.419803:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607107712 00000100:00100000:0.0:1788536028.419808:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607107712 00000100:00100000:0.0:1788536028.419843:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788536028.419850:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+15:15001:x1875415607107712:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788536028.420013:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+15:15001:x1875415607107712:12345-0@lo:503:mount.lustre.0 Request processed in 163us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536028.420020:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788536028.420107:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107712:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788536028.420611:0:15001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788536028.420668:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536028.420706:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536028.420719:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788536028.420858:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607107840 00000100:00100000:0.0:1788536028.420863:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607107840 00000100:00100000:0.0:1788536028.420924:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788536028.420931:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+15:15001:x1875415607107840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536028.421061:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+15:15001:x1875415607107840:12345-0@lo:502:mount.lustre.0 Request processed in 130us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536028.421068:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788536028.421155:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107840:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536028.421388:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788536028.421433:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788536028.421483:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788536028.421530:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788536028.421571:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788536028.421619:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788536028.421655:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788536028.421689:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788536028.421712:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536028.421834:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536028.421883:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607107968 00000100:00100000:0.0:1788536028.421904:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607107968 00000100:00100000:1.0:1788536028.421956:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788536028.421994:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788536028.422002:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+15:15001:x1875415607107968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536028.422261:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+15:15001:x1875415607107968:12345-0@lo:502:mount.lustre.0 Request processed in 260us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536028.422269:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788536028.422380:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607107968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536028.422455:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788536028.422471:0:15001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788536028.424467:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536028.424478:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536028.424481:0:15019:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788536028.424488:0:15019:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a98601c800 00000020:00000080:3.0:1788536028.424490:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788536028.424497:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536028.424500:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536028.424501:0:15019:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788536028.424504:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536028.424506:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536028.424508:0:15019:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788536028.424511:0:15019:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a98601c800 00000020:00000080:3.0:1788536028.424512:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788536028.424598:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536028.424603:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536028.424604:0:15019:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788536028.424607:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536028.424610:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536028.424611:0:15019:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788536028.424614:0:15019:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a98601c800 00000020:00000080:3.0:1788536028.424616:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788536028.426044:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536028.426054:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536028.426056:0:15019:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788536028.426060:0:15019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788536028.429850:0:15001:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788536028.429905:0:15001:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788536028.429926:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4ae3 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536028.429939:0:15001:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4ae3 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536028.429984:0:15001:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788536028.429987:0:15001:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a98601c800 10000000:01000000:1.0:1788536028.429991:0:15001:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a98601c800 10000000:01000000:1.0:1788536028.429999:0:15001:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788536028.430005:0:15001:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a98601c800 from 1 10000000:01000000:1.0:1788536028.430008:0:15001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788536028.430043:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0aa00/0x74f51638375d4aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536028.430052:0:15001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0aa00/0x74f51638375d4aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536028.430063:0:15001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0aa00/0x74f51638375d4aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536028.430085:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607108096:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536028.430145:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536028.430179:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788536028.430256:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607108096 00000100:00100000:0.0:1788536028.430263:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607108096 00000100:00100000:0.0:1788536028.430309:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788536028.430318:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+15:15001:x1875415607108096:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536028.430330:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536028.430343:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a987eca000/0x74f51638375d4af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4aea expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536028.430365:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a987eca000/0x74f51638375d4af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4aea expref: 16 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536028.430383:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a987eca000/0x74f51638375d4af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4aea expref: 16 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536028.430392:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a987eca000, rc 0) 00000100:00100000:0.0:1788536028.430427:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15001:x1875415607108096:12345-0@lo:101:mount.lustre.0 Request processed in 110us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536028.430434:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788536028.430510:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607108096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536028.430524:0:15001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0aa00/0x74f51638375d4aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4af1 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536028.430544:0:15001:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0aa00/0x74f51638375d4aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4af1 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.431236:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788536028.431269:0:15001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788536028.431541:0:15001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788536028.433025:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788536028.433088:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788536028.433124:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788536028.433174:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788536028.433210:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788536028.433258:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788536028.433290:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788536028.433338:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788536028.433388:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788536028.433424:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788536028.433456:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788536028.433504:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788536028.433539:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788536028.433573:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788536028.433621:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788536028.433656:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788536028.433689:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788536028.434068:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788536028.434111:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788536028.434148:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788536028.434196:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788536028.434232:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788536028.434266:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788536028.434341:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788536028.434380:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788536028.434414:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788536028.434470:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788536028.434506:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788536028.434593:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788536028.434601:0:15001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788536028.434692:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607108224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536028.434767:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536028.434813:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9878d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788536028.434926:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607108224 00000100:00100000:3.0:1788536028.434933:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607108224 00000100:00100000:3.0:1788536028.434973:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788536028.434981:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15001:x1875415607108224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788536028.435196:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15001:x1875415607108224:12345-0@lo:501:mount.lustre.0 Request processed in 215us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536028.435204:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788536028.435230:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607108224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536028.435264:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607108352:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536028.436257:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536028.436665:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988b960c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788536028.437857:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607108352 00000100:00100000:1.0:1788536028.437868:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607108352 00000100:00100000:1.0:1788536028.437926:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788536028.437935:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15001:x1875415607108352:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536028.438128:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15001:x1875415607108352:12345-0@lo:503:mount.lustre.0 Request processed in 194us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536028.438137:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788536028.440420:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607108352:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788536028.442592:0:15001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788536028.442789:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607108480:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536028.443275:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536028.443330:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988b960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788536028.443852:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607108480 00000100:00100000:0.0:1788536028.443860:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607108480 00000100:00100000:0.0:1788536028.443921:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788536028.443930:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15001:x1875415607108480:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536028.444149:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15001:x1875415607108480:12345-0@lo:502:mount.lustre.0 Request processed in 220us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536028.444156:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788536028.444249:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607108480:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788536028.444541:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788536028.444589:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788536028.444637:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788536028.444684:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788536028.444721:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788536028.444768:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788536028.444804:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788536028.444849:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788536028.444906:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788536028.444940:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788536028.444969:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788536028.445786:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788536028.445859:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788536028.445914:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788536028.445965:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788536028.446002:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788536028.446235:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788536028.446300:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788536028.446338:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788536028.446374:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788536028.446436:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788536028.446485:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788536028.447352:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788536028.447430:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788536028.447845:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788536028.447881:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788536028.447952:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788536028.447985:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788536028.448028:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788536028.448242:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788536028.448277:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788536028.448370:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788536028.449284:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788536028.449863:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788536028.449995:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788536028.450058:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788536028.450098:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788536028.450132:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788536028.450180:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788536028.450214:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788536028.450258:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607108608:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536028.450325:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536028.450363:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987f889c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788536028.450462:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607108608 00000100:00100000:3.0:1788536028.450469:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607108608 00000100:00100000:3.0:1788536028.450506:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788536028.450514:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15001:x1875415607108608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788536028.450714:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15001:x1875415607108608:12345-0@lo:502:mount.lustre.0 Request processed in 199us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536028.450722:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788536028.450851:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607108608:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788536028.450928:0:15001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788536028.450938:0:15001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788536028.457079:0:15024:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788536028.457096:0:15024:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97a9ac7acd40) 00000020:00000080:3.0:1788536028.457115:0:15024:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788536028.457202:0:15024:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a98601c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788536028.457207:0:15024:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a98601c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788536028.457209:0:15024:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a98601c800 3 00010000:00080000:3.0:1788536028.457237:0:15024:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a99c9c3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788536028.460351:0:15024:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788536028.460566:0:15024:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788536028.460600:0:15024:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788536028.460612:0:15024:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x74f51638375d4aff 00000100:00080000:3.0:1788536028.460624:0:15024:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788536028.460629:0:15024:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97a99c9c3800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788536028.460664:0:15024:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9bf76b100 x1875415607108736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788536028.460688:0:15024:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788536028.460872:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788536028.460877:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788536028.460880:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788536028.460883:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788536028.460947:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788536028.460959:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607108864:0@lo:400:kworker.0 00000100:00100000:2.0:1788536028.461168:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536028.461214:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607108864 00000100:00100000:2.0:1788536028.461220:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607108864 00000100:00100000:2.0:1788536028.461251:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788536028.461259:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b740a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607108864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536028.461360:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b740a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607108864:12345-0@lo:400:kworker.0 Request processed in 101us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536028.461368:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788536028.461705:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b7408000 x1875415607108864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536028.461719:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607108864:0@lo:400:kworker.0 00000100:00100000:1.0:1788536028.461999:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875415607108736:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788536028.462035:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536028.462079:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607108736 00000100:00100000:1.0:1788536028.462083:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607108736 00000100:00100000:1.0:1788536028.462104:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788536028.462109:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875415607108736:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788536028.462130:0:14322:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:1.0:1788536028.462161:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x74f51638375d4b06 00000004:00100000:1.0:1788536028.462173:0:14322:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788536028.462201:0:14322:0:(import.c:65:import_set_state_nolock()) ffff97a98548f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788536028.462240:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875415607108736:12345-0@lo:38:llog_process_th.0 Request processed in 129us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536028.462247:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788536028.462284:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9bf76b100 x1875415607108736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788536038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536028.462293:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788536028.462300:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788536028.462306:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788536028.462310:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788536028.462312:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a99c9c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788536028.462317:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875415607108736:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788536028.463014:0:15024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788536028.465077:0:15001:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788536028.465114:0:15001:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788536028.465138:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0aa00/0x74f51638375d4aea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4af1 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.465151:0:15001:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0aa00/0x74f51638375d4aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4af1 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788536028.465203:0:15001:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788536028.465205:0:15001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788536028.465207:0:15001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788536028.465208:0:15001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788536028.465209:0:15001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788536028.465210:0:15001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788536028.465212:0:15001:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788536028.465214:0:15001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788536028.465215:0:15001:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788536028.465218:0:15001:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788536028.465221:0:15001:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788536028.465222:0:15001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788536028.465223:0:15001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788536028.465225:0:15001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788536028.465226:0:15001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788536028.465227:0:15001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788536028.465228:0:15001:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788536028.465229:0:15001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788536028.465230:0:15001:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788536028.465255:0:15001:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788536028.465274:0:15001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607108992:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788536028.465348:0:15001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536028.465394:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607108992 00000100:00100000:2.0:1788536028.465400:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607108992 00000100:00100000:2.0:1788536028.465439:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788536028.465763:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15001:x1875415607108992:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788536028.465797:0:14315:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788536028.465810:0:14315:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788536028.466178:0:15001:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988b96f00 going to sleep for 11 seconds 20000000:01000000:2.0:1788536028.530242:0:14315:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788536028.530261:0:14315:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788536028.530842:0:14336:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788536028.530847:0:14336:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788536028.530868:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536028.530916:0:14336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a980031400/0x74f51638375d4a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4a73 expref: 16 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536028.530927:0:14336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536028.530967:0:14336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a980031400/0x74f51638375d4a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d4a73 expref: 16 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536028.530982:0:14336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a980031400/0x74f51638375d4a7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d4a73 expref: 16 pid: 14315 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536028.530997:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf768700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14336:1875415607109120:0@lo:104: 00000100:00100000:3.0:1788536028.531057:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536028.531093:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860c0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788536028.531215:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607109120 00000100:00100000:2.0:1788536028.531223:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607109120 00000100:00100000:2.0:1788536028.531284:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788536028.531349:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+3:14336:x1875415607109120:12345-0@lo:104: 00010000:00010000:2.0:1788536028.531363:0:14303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4a7a expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.531421:0:14303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788536028.531427:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+3:14336:x1875415607109120:12345-0@lo:104: Request processed in 136us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536028.531434:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788536028.531454:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536028.531460:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4a7a expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.531467:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51800 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:2.0:1788536028.531471:0:14309:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d4a7a expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.531479:0:14309:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d4a7a expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788536028.531486:0:14309:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d4a7a expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536028.531491:0:14309:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788536028.531517:0:14309:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4a7a expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.531523:0:14309:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788536028.531541:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4a7a expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.531559:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51800/0x74f51638375d4a73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4a7a expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.531575:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536028.531577:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536028.531579:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536028.531602:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49edad1-b206-4ca7-85f1-c4b27706521e:3308:1875415607109248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788536028.531629:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536028.531667:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607109248 00000100:00100000:2.0:1788536028.531671:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607109248 00010000:00010000:2.0:1788536028.531688:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a980031400/0x74f51638375d4a7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4a73 expref: 17 pid: 14315 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536028.531708:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788536028.531715:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49edad1-b206-4ca7-85f1-c4b27706521e+17:3308:x1875415607109248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788536028.531723:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788536028.531728:0:14307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a980031400/0x74f51638375d4a7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4a73 expref: 17 pid: 14315 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536028.531855:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf768700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14336:1875415607109120:0@lo:104: 00010000:00010000:0.0:1788536028.531873:0:14336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.532048:0:14307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a980031400/0x74f51638375d4a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d4a73 expref: 17 pid: 14315 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.532062:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980031400/0x74f51638375d4a7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d4a73 expref: 17 pid: 14315 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.532074:0:14307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.532093:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788536028.532106:0:14307:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001847706s 00010000:00010000:2.0:1788536028.532110:0:14307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.532116:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.532123:0:14307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.532129:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.532134:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a980030e00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:2.0:1788536028.532138:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.532145:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.532158:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.532167:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788536028.532198:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49edad1-b206-4ca7-85f1-c4b27706521e+16:3308:x1875415607109248:12345-0@lo:103:ldlm_bl.0 Request processed in 484us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536028.532205:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788536028.532240:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49edad1-b206-4ca7-85f1-c4b27706521e:3308:1875415607109248:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788536028.532256:0:14336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.532264:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536028.532270:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980030e00/0x74f51638375d4b0d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536028.540510:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+15:15001:x1875415607108992:12345-0@lo:253:mount.lustre.0 Request processed in 74742us (75152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536028.540524:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788536028.540609:0:15001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15001:1875415607108992:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788536028.540626:0:15001:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788536028.540630:0:15001:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788536028.540631:0:15001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788536028.540633:0:15001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536028.540634:0:15001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536028.540635:0:15001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536028.540636:0:15001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536028.540637:0:15001:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788536028.540639:0:15001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536028.540640:0:15001:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788536028.540653:0:15001:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788536028.545526:0:15001:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788536028.545691:0:15001:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788536028.546021:0:15001:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788536028.546174:0:15001:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788536028.546389:0:15001:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788536028.546597:0:15001:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788536028.547587:0:15001:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788536028.638782:0:15001:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788536028.638793:0:15001:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788536028.638834:0:15001:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788536028.638908:0:15001:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788536028.638921:0:15001:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788536028.638947:0:15001:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:1.0:1788536028.685980:0:14353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788536029.454034:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788536030.223599:0:14317:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788536030.223607:0:14317:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a988040000 from 7 10000000:01000000:2.0:1788536030.223612:0:14317:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788536030.223663:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536030.223675:0:14317:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536030.223686:0:14317:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536030.224008:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607109376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788536030.224073:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536030.224216:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988b966c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788536030.224616:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607109376 00000100:00100000:3.0:1788536030.224624:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607109376 00000100:00100000:3.0:1788536030.224679:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788536030.224689:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+15:14317:x1875415607109376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788536030.224701:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536030.224718:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a980030200/0x74f51638375d4b1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4b14 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536030.224740:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980030200/0x74f51638375d4b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4b14 expref: 16 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536030.224770:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a980030200/0x74f51638375d4b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4b14 expref: 16 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536030.224778:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980030200, rc 0) 00000100:00100000:3.0:1788536030.224845:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+16:14317:x1875415607109376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536030.224853:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788536030.224878:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607109376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788536030.225017:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4b1b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536030.225028:0:14317:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4b1b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536030.225208:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607109504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788536030.225240:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536030.225358:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860c0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788536030.225393:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607109504 00000100:00100000:2.0:1788536030.225398:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607109504 00000100:00100000:2.0:1788536030.225457:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788536030.225466:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+16:14317:x1875415607109504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788536030.225479:0:14315:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788536030.225493:0:14315:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788536030.225496:0:14315:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788536030.225585:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+16:14317:x1875415607109504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536030.225592:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788536030.225645:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607109504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788536030.225696:0:14317:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788536030.225703:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4b1b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536030.225712:0:14317:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4b1b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536030.477202:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536031.504403:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536032.530848:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788536033.549066:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788536033.549072:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788536033.549075:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788536033.549078:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788536033.549143:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49edad1-b206-4ca7-85f1-c4b27706521e:3309:1875415607109632:0@lo:400:kworker.0 00000100:00100000:2.0:1788536033.549217:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536033.549283:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607109760:0@lo:400:kworker.0 00000100:00100000:2.0:1788536033.549315:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536033.549351:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788536033.549357:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607109888:0@lo:400:kworker.0 00000100:00100000:2.0:1788536033.549382:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536033.549414:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607109632 00000100:00100000:2.0:1788536033.549421:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607109632 00000100:00100000:2.0:1788536033.549472:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788536033.549481:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+16:3309:x1875415607109632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536033.549527:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+16:3309:x1875415607109632:12345-0@lo:400:kworker.0 Request processed in 47us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536033.549535:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788536033.549568:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607109760 00000100:00100000:2.0:1788536033.549572:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607109760 00000100:00100000:2.0:1788536033.549594:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607109888 00000100:00100000:2.0:1788536033.549597:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607109888 00000100:00100000:2.0:1788536033.549620:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788536033.549627:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607109760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536033.549664:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875415607109760:12345-0@lo:400:kworker.0 Request processed in 38us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536033.549670:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788536033.549681:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788536033.549688:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b740a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607109888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536033.549715:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b740a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607109888:12345-0@lo:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536033.549721:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788536033.549760:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788536033.549787:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b740aa00 x1875415607109888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536033.549827:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607109888:0@lo:400:kworker.0 00010000:00080000:2.0:1788536033.549841:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9b740b800 x1875415607109760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536033.549849:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875415607109760:0@lo:400:kworker.0 00000100:00100000:2.0:1788536033.549875:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49edad1-b206-4ca7-85f1-c4b27706521e:3309:1875415607109632:0@lo:400:kworker.0 00010000:00010000:3.0:1788536033.554725:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536034.574978:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788536034.880669:0:15367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788536035.605037:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536036.627015:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536037.645045:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788536038.674473:0:13881:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536038.674480:0:13881:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788536038.674482:0:13881:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536038.674496:0:13881:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788536038.674505:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788536038.674526:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49edad1-b206-4ca7-85f1-c4b27706521e:3309:1875415607110016:0@lo:400:kworker.0 00000100:00100000:3.0:1788536038.674599:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536038.674650:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607110016 00000100:00100000:3.0:1788536038.674658:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607110016 00000100:00100000:3.0:1788536038.674696:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788536038.674704:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+16:3309:x1875415607110016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536038.674747:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+16:3309:x1875415607110016:12345-0@lo:400:kworker.0 Request processed in 43us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536038.674765:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788536038.674808:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c49edad1-b206-4ca7-85f1-c4b27706521e:3309:1875415607110016:0@lo:400:kworker.0 00000100:00100000:3.0:1788536038.674837:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607110144:0@lo:400:kworker.0 00000100:00100000:3.0:1788536038.674858:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536038.674904:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607110144 00000100:00100000:3.0:1788536038.674908:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607110144 00000100:00100000:3.0:1788536038.674931:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788536038.674936:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607110144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536038.674963:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607110144:12345-0@lo:400:kworker.0 Request processed in 27us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536038.674968:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788536038.674994:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9bf76b480 x1875415607110144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536038.675005:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607110144:0@lo:400:kworker.0 00000100:00100000:3.0:1788536038.675046:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607110272:0@lo:400:kworker.0 00000100:00100000:3.0:1788536038.675073:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536038.675102:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607110272 00000100:00100000:3.0:1788536038.675106:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607110272 00000100:00100000:3.0:1788536038.675138:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788536038.675144:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607110272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536038.675175:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607110272:12345-0@lo:400:kworker.0 Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536038.675181:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788536038.675195:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788536038.675212:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a9bf76b480 x1875415607110272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536038.675221:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607110272:0@lo:400:kworker.0 00010000:00010000:0.0:1788536038.676869:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788536038.926981:0:14353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788536039.695626:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536040.718118:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788536041.514571:0:15716:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788536041.514575:0:15716:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788536041.514690:0:15716:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a9ac46b000 00000020:01000004:1.0:1788536041.514706:0:15716:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788536041.514719:0:15716:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788536041.514755:0:15716:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97a990fa19c0) 00000020:00000080:1.0:1788536041.514775:0:15716:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788536041.565856:0:15716:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788536041.566560:0:15716:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788536041.567832:0:15716:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788536041.568284:0:15716:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788536041.568493:0:15716:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788536041.569256:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 487: rc = 0 00100000:10000000:3.0:1788536041.569355:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 487: rc = 0 00100000:10000000:3.0:1788536041.569497:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 487: rc = 0 00100000:10000000:3.0:1788536041.571522:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 774: rc = 0 00100000:10000000:3.0:1788536041.572351:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 774: rc = 0 00100000:10000000:3.0:1788536041.572623:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 774: rc = 0 00100000:10000000:3.0:1788536041.573250:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 774: rc = 0 00100000:10000000:3.0:1788536041.574137:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 774: rc = 0 00100000:10000000:3.0:1788536041.574397:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 774: rc = 0 00000020:00000080:3.0:1788536041.575346:0:15716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788536041.575363:0:15716:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788536041.575373:0:15716:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x74f51638375d4b29 00000020:01000004:3.0:1788536041.575382:0:15716:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788536041.575400:0:15716:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788536041.575404:0:15716:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788536041.575409:0:15716:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788536041.575431:0:15716:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788536041.575435:0:15716:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788536041.595101:0:15716:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788536041.595148:0:15716:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788536041.595153:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788536041.595154:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788536041.595156:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788536041.595157:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788536041.595158:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788536041.595159:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788536041.595161:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788536041.595163:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788536041.595164:0:15716:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788536041.595168:0:15716:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788536041.595170:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788536041.595171:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788536041.595172:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788536041.595174:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788536041.595175:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788536041.595176:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788536041.595177:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788536041.595178:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788536041.595179:0:15716:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788536041.595209:0:15716:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788536041.595230:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607110400:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788536041.595297:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536041.596746:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98895e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788536041.607359:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607110400 00000100:00100000:2.0:1788536041.607373:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607110400 00000100:00100000:2.0:1788536041.607437:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788536041.607448:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15716:x1875415607110400:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788536041.607504:0:14313:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788536041.607508:0:14313:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788536041.607511:0:14313:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788536041.624418:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15716:x1875415607110400:12345-0@lo:253:mount.lustre.0 Request processed in 16961us (29109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536041.624431:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788536041.628156:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607110400:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788536041.628179:0:15716:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788536041.628213:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788536041.628215:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788536041.628216:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788536041.628217:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788536041.628219:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788536041.628220:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788536041.628222:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788536041.628223:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788536041.628225:0:15716:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788536041.628265:0:15716:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a9ac46b000 from lustre-OST0001 10000000:01000000:3.0:1788536041.628299:0:15716:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788536041.628302:0:15716:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788536041.628309:0:15716:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97a9b67cb380 local copy 00010000:00010000:3.0:1788536041.628320:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51c00/0x74f51638375d499a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49a1 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536041.628759:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607110528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788536041.628824:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536041.628875:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98895e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788536041.628923:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607110528 00000100:00100000:2.0:1788536041.628931:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607110528 00000100:00100000:2.0:1788536041.628981:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788536041.628991:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15716:x1875415607110528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536041.629281:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15716:x1875415607110528:12345-0@lo:501:mount.lustre.0 Request processed in 290us (454us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788536041.629300:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788536041.629378:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607110528:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788536041.629394:0:15716:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788536041.629800:0:15716:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788536041.629809:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51c00/0x74f51638375d499a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49a1 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.629821:0:15716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9bfc51c00/0x74f51638375d499a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d49a1 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788536041.629848:0:15716:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a9ac46b000 10000000:01000000:3.0:1788536041.629852:0:15716:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788536041.629858:0:15716:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788536041.629866:0:15716:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788536041.629871:0:15716:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788536041.629873:0:15716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788536041.629938:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980030e00/0x74f51638375d4b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.629947:0:15716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a980030e00/0x74f51638375d4b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.629956:0:15716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a980030e00/0x74f51638375d4b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536041.629972:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607110656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788536041.630008:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536041.630136:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607110656 00000100:00100000:2.0:1788536041.630143:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607110656 00000100:00100000:2.0:1788536041.630184:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788536041.630192:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+16:15716:x1875415607110656:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788536041.630206:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536041.630221:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9bfc51a00/0x74f51638375d4b37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4b30 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.630245:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9bfc51a00/0x74f51638375d4b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4b30 expref: 17 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.630256:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9bfc51a00/0x74f51638375d4b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4b30 expref: 17 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.630264:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc51a00, rc 0) 00000100:00100000:2.0:1788536041.630291:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+17:15716:x1875415607110656:12345-0@lo:101:mount.lustre.0 Request processed in 100us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536041.630297:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788536041.630578:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98895e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788536041.630597:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607110656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536041.630611:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a980030e00/0x74f51638375d4b30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4b37 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.630619:0:15716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a980030e00/0x74f51638375d4b30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4b37 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788536041.632435:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788536041.636392:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788536041.636682:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788536041.636754:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788536041.636786:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788536041.636827:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788536041.636870:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788536041.636986:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788536041.637466:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788536041.637476:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788536041.637565:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607110784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536041.637631:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536041.637677:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a997579240 going to sleep for 11 seconds 00000100:00100000:2.0:1788536041.637801:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607110784 00000100:00100000:2.0:1788536041.637808:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607110784 00000100:00100000:2.0:1788536041.637861:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788536041.637869:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+17:15716:x1875415607110784:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536041.639381:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+17:15716:x1875415607110784:12345-0@lo:501:mount.lustre.0 Request processed in 1505us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536041.639393:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788536041.640485:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607110784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536041.640548:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607110912:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536041.640768:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536041.640878:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9924cb540 going to sleep for 11 seconds 00000100:00100000:3.0:1788536041.641325:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607110912 00000100:00100000:3.0:1788536041.641334:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607110912 00000100:00100000:3.0:1788536041.641496:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788536041.641507:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+17:15716:x1875415607110912:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788536041.641987:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+17:15716:x1875415607110912:12345-0@lo:503:mount.lustre.0 Request processed in 480us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536041.641996:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788536041.642987:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607110912:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788536041.643714:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788536041.643810:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536041.643879:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536041.646722:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9924cb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788536041.646837:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607111040 00000100:00100000:0.0:1788536041.646846:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607111040 00000100:00100000:2.0:1788536041.647640:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788536041.647667:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+17:15716:x1875415607111040:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536041.648272:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+17:15716:x1875415607111040:12345-0@lo:502:mount.lustre.0 Request processed in 605us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536041.648281:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788536041.648460:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536041.648731:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788536041.648797:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788536041.648828:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788536041.648927:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788536041.648967:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788536041.649249:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788536041.649301:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788536041.649334:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788536041.649375:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788536041.649414:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111168:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536041.649471:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536041.649501:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9924cb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788536041.649646:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607111168 00000100:00100000:2.0:1788536041.649652:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607111168 00000100:00100000:2.0:1788536041.649682:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788536041.649689:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+17:15716:x1875415607111168:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536041.649880:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+17:15716:x1875415607111168:12345-0@lo:502:mount.lustre.0 Request processed in 190us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536041.649929:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788536041.650620:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111168:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536041.650713:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788536041.650731:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788536041.653641:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788536041.653652:0:15717:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788536041.653659:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536041.653661:0:15717:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788536041.653668:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788536041.653681:0:15717:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97a9b91d4d40) 00000020:00000080:0.0:1788536041.653701:0:15717:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788536041.653707:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788536041.653779:0:15717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a9ac46b000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788536041.653787:0:15717:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788536041.653794:0:15717:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x74f51638375d4b45 00010000:00010000:1.0:1788536041.657436:0:15717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788536041.659532:0:15717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788536041.664585:0:15717:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788536041.669111:0:15717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788536041.669125:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536041.669132:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536041.669134:0:15717:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788536041.669138:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536041.669142:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536041.669144:0:15717:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788536041.669147:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788536041.669149:0:15717:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788536041.669163:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536041.669165:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536041.669166:0:15717:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788536041.669169:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536041.669171:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536041.669172:0:15717:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788536041.669175:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788536041.669359:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536041.669364:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536041.669365:0:15717:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788536041.669369:0:15717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788536041.669827:0:15716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788536041.669867:0:15716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788536041.669911:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980030e00/0x74f51638375d4b30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4b37 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.669923:0:15716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a980030e00/0x74f51638375d4b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4b37 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536041.669931:0:15716:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a9ac46b000 from 1 10000000:01000000:1.0:1788536041.669934:0:15716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788536041.669970:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.669979:0:15716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.669989:0:15716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536041.670026:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536041.670295:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536041.670336:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9924cb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788536041.670519:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607111296 00000100:00100000:2.0:1788536041.670526:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607111296 00000100:00100000:2.0:1788536041.670579:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788536041.670588:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+17:15716:x1875415607111296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788536041.670611:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536041.670624:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9bfc50600/0x74f51638375d4b53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4b4c expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.670647:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9bfc50600/0x74f51638375d4b53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4b4c expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.670657:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9bfc50600/0x74f51638375d4b53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4b4c expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.670666:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc50600, rc 0) 00000100:00100000:2.0:1788536041.670705:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+18:15716:x1875415607111296:12345-0@lo:101:mount.lustre.0 Request processed in 118us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536041.670728:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788536041.671323:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536041.671341:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4b53 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.671363:0:15716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4b53 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788536041.671876:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788536041.672547:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788536041.673421:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788536041.673499:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788536041.673564:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788536041.673573:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788536041.678922:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536041.678991:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536041.679034:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9924cb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788536041.679067:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607111424 00000100:00100000:1.0:1788536041.679074:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607111424 00000100:00100000:1.0:1788536041.679119:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788536041.679128:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bfdfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+18:15716:x1875415607111424:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536041.679369:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bfdfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+18:15716:x1875415607111424:12345-0@lo:501:mount.lustre.0 Request processed in 240us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536041.679377:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788536041.679429:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536041.679465:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536041.679504:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536041.679519:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9924cb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788536041.679531:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607111552 00000100:00100000:1.0:1788536041.679535:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607111552 00000100:00100000:1.0:1788536041.679553:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788536041.679567:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bfdfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+18:15716:x1875415607111552:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536041.679851:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bfdfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+18:15716:x1875415607111552:12345-0@lo:503:mount.lustre.0 Request processed in 285us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536041.679858:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788536041.679915:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111552:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788536041.680351:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788536041.686404:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536041.686493:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536041.686578:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988b96540 going to sleep for 11 seconds 00000100:00100000:2.0:1788536041.687576:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607111680 00000100:00100000:2.0:1788536041.687588:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607111680 00000100:00100000:2.0:1788536041.687697:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788536041.687706:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bfdfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+18:15716:x1875415607111680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536041.688023:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bfdfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+18:15716:x1875415607111680:12345-0@lo:502:mount.lustre.0 Request processed in 317us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536041.688033:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788536041.688079:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536041.688335:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788536041.688386:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788536041.688437:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788536041.688474:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788536041.688507:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788536041.688551:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788536041.688583:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788536041.688614:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788536041.688646:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536041.688691:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536041.700984:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988b96540 going to sleep for 11 seconds 00000100:00100000:0.0:1788536041.701790:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607111808 00000100:00100000:0.0:1788536041.701802:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607111808 00000100:00100000:2.0:1788536041.701858:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788536041.701935:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+18:15716:x1875415607111808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536041.702261:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+18:15716:x1875415607111808:12345-0@lo:502:mount.lustre.0 Request processed in 329us (13568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536041.702366:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536041.702663:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788536041.702679:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000100:00100000:2.0:1788536041.703355:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000020:01000000:0.0:1788536041.704475:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788536041.704487:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536041.704490:0:15721:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788536041.704496:0:15721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a9ac46b000 00000020:00000080:0.0:1788536041.704499:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788536041.704505:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788536041.704508:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536041.704519:0:15721:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788536041.704522:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788536041.704525:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536041.704527:0:15721:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788536041.704530:0:15721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a9ac46b000 00000020:00000080:0.0:1788536041.704533:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788536041.704586:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788536041.704589:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536041.704591:0:15721:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788536041.704594:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788536041.704596:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536041.704598:0:15721:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788536041.704601:0:15721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a9ac46b000 00000020:00000080:0.0:1788536041.704603:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788536041.704638:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788536041.704641:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536041.704643:0:15721:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788536041.704646:0:15721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788536041.705277:0:15716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788536041.705306:0:15716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788536041.705365:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4b53 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.705378:0:15716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4b53 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536041.705421:0:15716:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788536041.705423:0:15716:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a9ac46b000 10000000:01000000:1.0:1788536041.705427:0:15716:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a9ac46b000 10000000:01000000:1.0:1788536041.705431:0:15716:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788536041.705437:0:15716:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a9ac46b000 from 1 10000000:01000000:1.0:1788536041.705440:0:15716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788536041.705487:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b600/0x74f51638375d4b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.705496:0:15716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b600/0x74f51638375d4b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.705508:0:15716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b600/0x74f51638375d4b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536041.705532:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536041.705597:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536041.705637:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988b96d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788536041.705742:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607111936 00000100:00100000:2.0:1788536041.705749:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607111936 00000100:00100000:2.0:1788536041.705797:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788536041.705806:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+18:15716:x1875415607111936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788536041.705820:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536041.705832:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9bfc51000/0x74f51638375d4b61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4b5a expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.705854:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9bfc51000/0x74f51638375d4b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4b5a expref: 19 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.705865:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9bfc51000/0x74f51638375d4b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4b5a expref: 19 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.705901:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9bfc51000, rc 0) 00000100:00100000:2.0:1788536041.705942:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+19:15716:x1875415607111936:12345-0@lo:101:mount.lustre.0 Request processed in 138us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536041.705949:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788536041.705955:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607111936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536041.705968:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b600/0x74f51638375d4b5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4b61 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.705979:0:15716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b600/0x74f51638375d4b5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4b61 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788536041.706601:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788536041.706920:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788536041.707190:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788536041.707233:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788536041.707268:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788536041.707314:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788536041.707350:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788536041.707399:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788536041.707436:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788536041.707469:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788536041.707516:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788536041.707551:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788536041.707585:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788536041.707635:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788536041.707672:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788536041.707706:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788536041.707764:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788536041.707817:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788536041.707845:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788536041.707912:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788536041.707945:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788536041.707974:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788536041.708020:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788536041.708055:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788536041.708087:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788536041.708132:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788536041.708167:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788536041.708201:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788536041.708249:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788536041.708307:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788536041.708344:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788536041.708404:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788536041.708439:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788536041.708488:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788536041.708522:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788536041.708569:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788536041.708601:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788536041.708644:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788536041.708675:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788536041.709754:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788536041.709944:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788536041.710176:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607112064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536041.710471:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536041.710522:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988b96cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788536041.710680:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607112064 00000100:00100000:0.0:1788536041.710688:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607112064 00000100:00100000:0.0:1788536041.710751:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788536041.710760:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+19:15716:x1875415607112064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536041.711300:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+19:15716:x1875415607112064:12345-0@lo:501:mount.lustre.0 Request processed in 540us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536041.711310:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788536041.711691:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607112064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536041.711744:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607112192:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788536041.711786:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536041.711822:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a997579540 going to sleep for 11 seconds 00000100:00100000:1.0:1788536041.711838:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607112192 00000100:00100000:1.0:1788536041.711843:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607112192 00000100:00100000:1.0:1788536041.711902:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788536041.711910:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+19:15716:x1875415607112192:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536041.712494:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+19:15716:x1875415607112192:12345-0@lo:503:mount.lustre.0 Request processed in 582us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536041.712502:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788536041.712673:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607112192:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788536041.713444:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788536041.713530:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607112320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536041.713582:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536041.713624:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988b96240 going to sleep for 11 seconds 00000100:00100000:0.0:1788536041.713669:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607112320 00000100:00100000:0.0:1788536041.713675:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607112320 00000100:00100000:0.0:1788536041.713731:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788536041.713749:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+19:15716:x1875415607112320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536041.714478:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+19:15716:x1875415607112320:12345-0@lo:502:mount.lustre.0 Request processed in 728us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536041.714486:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788536041.724397:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607112320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788536041.724797:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788536041.724864:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788536041.724923:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788536041.724967:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788536041.725001:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788536041.725058:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788536041.725090:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788536041.725114:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788536041.725159:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788536041.725193:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788536041.725221:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788536041.725264:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788536041.725297:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788536041.725328:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788536041.725373:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788536041.725406:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788536041.725437:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788536041.725479:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788536041.725524:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788536041.725556:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788536041.725601:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788536041.725633:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788536041.725665:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788536041.725707:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788536041.725762:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788536041.725795:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788536041.725840:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788536041.725871:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788536041.725920:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788536041.725967:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788536041.725998:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788536041.726028:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788536041.726061:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788536041.726105:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788536041.726155:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788536041.726203:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788536041.726235:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788536041.726266:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788536041.726325:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788536041.726362:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788536041.726409:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607112448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536041.726496:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536041.726554:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987b51840 going to sleep for 11 seconds 00000100:00100000:0.0:1788536041.727963:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607112448 00000100:00100000:0.0:1788536041.727977:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607112448 00000100:00100000:0.0:1788536041.728036:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788536041.728047:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+19:15716:x1875415607112448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536041.728297:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+19:15716:x1875415607112448:12345-0@lo:502:mount.lustre.0 Request processed in 252us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536041.728305:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788536041.728412:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607112448:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788536041.728510:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788536041.728525:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000100:00100000:3.0:1788536041.740962:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536026/real 1788536026] req@ffff97a9b7416a00 x1875415607106048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536041 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536041.740988:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a9b7416a00 x1875415607106048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536041 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536041.741009:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536026/real 1788536026] req@ffff97a9b7415180 x1875415607106176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536041 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536041.741021:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a9b7415180 x1875415607106176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536041 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788536041.741037:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a9bb3ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788536041.741051:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788536041.741064:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607106048:0@lo:8:kworker.0 00000100:00080000:3.0:1788536041.741070:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a987bbc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788536041.741074:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788536041.741076:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607106176:0@lo:8:kworker.0 00010000:00010000:3.0:1788536041.741300:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788536041.741311:0:13881:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536041.741320:0:13881:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788536041.741323:0:13881:0:(import.c:65:import_set_state_nolock()) ffff97a9bb3ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788536041.741327:0:13881:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 429 00000100:00080000:3.0:1788536041.741332:0:13881:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788536041.741337:0:13881:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97a9bb3ea800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788536041.741366:0:13881:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9bf769f80 x1875415607112576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788536041.741382:0:13881:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536041.741385:0:13881:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788536041.741386:0:13881:0:(import.c:65:import_set_state_nolock()) ffff97a987bbc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788536041.741389:0:13881:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 429 00000100:00080000:3.0:1788536041.741391:0:13881:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788536041.741394:0:13881:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a987bbc000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788536041.741403:0:13881:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9bf769880 x1875415607112704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788536041.741454:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607112576:0@lo:8:kworker.0 00000100:00100000:3.0:1788536041.741513:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536041.741547:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607112704:0@lo:8:kworker.0 00000100:00100000:3.0:1788536041.741570:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536041.741593:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607112832:0@lo:400:kworker.0 00000100:00100000:3.0:1788536041.741618:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536041.741645:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607112960:0@lo:400:kworker.0 00000100:00100000:3.0:1788536041.741667:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536041.741705:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607112576 00000100:00100000:3.0:1788536041.741715:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607112576 00000100:00100000:3.0:1788536041.741758:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607112704 00000100:00100000:3.0:1788536041.741761:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607112704 00000100:00100000:3.0:1788536041.741786:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788536041.741793:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875415607112576:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788536041.741819:0:15004:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:3.0:1788536041.741847:0:15004:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74f51638375d4b68 00002000:00100000:3.0:1788536041.741860:0:15004:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97a99c9c4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788536041.741864:0:15004:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788536041.741867:0:15004:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788536041.742624:0:15004:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788536041.742654:0:15004:0:(import.c:65:import_set_state_nolock()) ffff97a99c9c2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788536041.742722:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875415607112576:12345-0@lo:8:kworker.0 Request processed in 926us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536041.742731:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788536041.747341:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788536041.747359:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875415607112704:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788536041.747450:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875415607112704:12345-0@lo:8:kworker.0 Request processed in 94us (5877us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788536041.750554:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788536041.750594:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607112832 00000100:00100000:3.0:1788536041.750604:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607112832 00000100:00100000:3.0:1788536041.750649:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607112960 00000100:00100000:3.0:1788536041.750652:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607112960 00000100:00100000:3.0:1788536041.750676:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788536041.750684:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607112832:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788536041.752940:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf769f80 x1875415607112576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788536061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536041.752955:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788536041.752965:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788536041.752973:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788536041.752978:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788536041.752982:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a9bb3ea800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788536041.753025:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788536041.753031:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607112576:0@lo:8:kworker.0 00000100:00100000:2.0:1788536041.753048:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788536041.753052:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a987bbc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788536041.753061:0:3307:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788536041.753064:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607112704:0@lo:8:kworker.0 00000100:00100000:2.0:1788536041.753111:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788536041.753120:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000004:00080000:2.0:1788536041.753170:0:14343:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1788536041.753189:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14343:1875415607113216:0@lo:5:osp-pre-0-0.0 00000020:01000004:0.0:1788536041.755488:0:15724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788536041.755506:0:15724:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97a9b91d19c0) 00000020:00000080:0.0:1788536041.755530:0:15724:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788536041.755651:0:15724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a9ac46b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788536041.755656:0:15724:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a9ac46b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788536041.755659:0:15724:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a9ac46b000 3 00010000:00080000:0.0:1788536041.755693:0:15724:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a982a5c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.112@tcp at head 00000100:00100000:3.0:1788536041.756148:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875415607112832:12345-0@lo:400:kworker.0 Request processed in 5460us (14524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536041.756170:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788536041.756205:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788536041.756226:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607112960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536041.756445:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536041.756462:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607112960:12345-0@lo:400:kworker.0 Request processed in 247us (14791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536041.756470:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788536041.756483:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987b51840 going to sleep for 11 seconds 00000100:00080000:3.0:1788536041.756506:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788536041.756508:0:14342:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:3.0:1788536041.756782:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf769500 x1875415607112832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536041.756797:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875415607112832:0@lo:400:kworker.0 00000004:00080000:2.0:1788536041.756930:0:14342:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 443888041027ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788536041.757278:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607113088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788536041.757321:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536041.757355:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607113088 00000100:00100000:0.0:1788536041.757362:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607113088 00010000:00080000:2.0:1788536041.757370:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9bf76a680 x1875415607112960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536041.757381:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607112960:0@lo:400:kworker.0 00000100:00100000:2.0:1788536041.757399:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607113216 00000100:00100000:0.0:1788536041.757400:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788536041.757402:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607113216 00000100:00100000:0.0:1788536041.757408:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875415607113088:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788536041.757425:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788536041.757430:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b740aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14343:x1875415607113216:12345-0@lo:5:osp-pre-0-0.0 00002000:00000024:0.0:1788536041.757435:0:15006:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788536041.757473:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875415607113088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536041.757479:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788536041.758829:0:15724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788536041.759044:0:15724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788536041.759080:0:15724:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788536041.759094:0:15724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x74f51638375d4b76 00000100:00080000:0.0:1788536041.759105:0:15724:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788536041.759110:0:15724:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97a982a5c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788536041.759143:0:15724:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b6ac2680 x1875415607113344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788536041.759165:0:15724:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00002000:00080000:2.0:1788536041.761636:0:15003:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788536041.761648:0:15003:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788536041.761655:0:15003:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00080000:3.0:1788536041.762046:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788536041.763965:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875415607113344:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788536041.764060:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788536041.764084:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b740b100 x1875415607113088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788536057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536041.764112:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607113088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788536041.764149:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607113344 00000100:00100000:3.0:1788536041.764156:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607113344 00000100:00100000:3.0:1788536041.764196:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788536041.764204:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875415607113344:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788536041.764231:0:14322:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:3.0:1788536041.764268:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x74f51638375d4b7d 00000004:00100000:3.0:1788536041.764282:0:14322:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788536041.764315:0:14322:0:(import.c:65:import_set_state_nolock()) ffff97a99c9c6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788536041.764372:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875415607113344:12345-0@lo:38:llog_process_th.0 Request processed in 167us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536041.764380:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788536041.767665:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6ac2680 x1875415607113344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788536051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536041.767682:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788536041.767693:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788536041.767701:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788536041.767707:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788536041.767711:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a982a5c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788536041.767718:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875415607113344:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788536041.768330:0:15724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788536041.774938:0:15716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788536041.774973:0:15716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788536041.774991:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b600/0x74f51638375d4b5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4b61 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.775003:0:15716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b600/0x74f51638375d4b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4b61 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788536041.775426:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788536041.775430:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788536041.775431:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788536041.775433:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788536041.775434:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788536041.775436:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788536041.775437:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788536041.775439:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788536041.775441:0:15716:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788536041.775445:0:15716:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788536041.775447:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788536041.775449:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788536041.775450:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788536041.775451:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788536041.775452:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788536041.775453:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788536041.775454:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788536041.775455:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788536041.775456:0:15716:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788536041.775487:0:15716:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788536041.775509:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7408380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607113472:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788536041.775598:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536041.775637:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a988b96540 going to sleep for 11 seconds 00002000:00010000:2.0:1788536041.775690:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.775697:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009caae528/0x74f51638375d4b84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.775721:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.775725:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.775748:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009caae528/0x74f51638375d4b84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.775860:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009caae528/0x74f51638375d4b84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.775872:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009caae528/0x74f51638375d4b84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.775878:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009caae528/0x74f51638375d4b84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.775922:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788536041.776556:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.776564:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008023006a/0x74f51638375d4b8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.776572:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.776575:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.776580:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008023006a/0x74f51638375d4b8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.776590:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008023006a/0x74f51638375d4b8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.776610:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008023006a/0x74f51638375d4b8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.776617:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008023006a/0x74f51638375d4b8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.776630:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788536041.776704:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607113472 00000100:00100000:0.0:1788536041.776713:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607113472 00000100:00100000:0.0:1788536041.776768:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788536041.776778:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+19:15716:x1875415607113472:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788536041.776812:0:14314:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788536041.776826:0:14314:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1788536041.777139:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788536041.777147:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009caae528/0x74f51638375d4b84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.777156:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51800 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536041.777161:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009caae528/0x74f51638375d4b84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.777170:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009caae528/0x74f51638375d4b84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.777188:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009caae528/0x74f51638375d4b84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.777195:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009caae528/0x74f51638375d4b84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.777211:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536041.777215:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008023006a/0x74f51638375d4b8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.777221:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50000 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536041.777224:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008023006a/0x74f51638375d4b8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.777243:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008023006a/0x74f51638375d4b8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.777252:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008023006a/0x74f51638375d4b8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.777260:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008023006a/0x74f51638375d4b8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.777272:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536041.777274:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536041.777275:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536041.778234:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.778245:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d4b92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.778257:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.778262:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.778267:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d4b92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.778279:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d4b92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.778288:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d4b92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.778297:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d4b92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.778335:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788536041.778856:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.778863:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d4b99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.778871:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.778875:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.778879:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d4b99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.778907:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d4b99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.778917:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d4b99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.778924:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d4b99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.778933:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788536041.779455:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788536041.779463:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d4b92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.779473:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc51600 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536041.779477:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d4b92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.779496:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d4b92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.779513:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d4b92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.779535:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007607f644/0x74f51638375d4b92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.779553:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536041.779556:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d4b99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.779562:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536041.779565:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d4b99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.779572:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d4b99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.779581:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d4b99 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.779587:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e3f8d49/0x74f51638375d4b99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.779726:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536041.779728:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536041.779730:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536041.781664:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.781680:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002881c563/0x74f51638375d4ba0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.781696:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.781707:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.781716:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002881c563/0x74f51638375d4ba0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.781742:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002881c563/0x74f51638375d4ba0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.781755:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002881c563/0x74f51638375d4ba0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.781764:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002881c563/0x74f51638375d4ba0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.781784:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788536041.782922:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.782933:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e0857b1/0x74f51638375d4ba7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.782945:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.782949:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.782955:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e0857b1/0x74f51638375d4ba7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.782966:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e0857b1/0x74f51638375d4ba7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.782976:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e0857b1/0x74f51638375d4ba7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.782990:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e0857b1/0x74f51638375d4ba7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.784197:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788536041.784729:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.784750:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4bae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.784763:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.784767:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.784772:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4bae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.784783:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4bae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.784793:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4bae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.784800:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4bae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.784808:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788536041.785406:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.785414:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027c43044/0x74f51638375d4bb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.785429:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.785433:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.785438:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027c43044/0x74f51638375d4bb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.785449:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027c43044/0x74f51638375d4bb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.785459:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027c43044/0x74f51638375d4bb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.785467:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027c43044/0x74f51638375d4bb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.785476:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788536041.785873:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.785879:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b07b3e0f/0x74f51638375d4bbc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.785914:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.785918:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.785923:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b07b3e0f/0x74f51638375d4bbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.785933:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b07b3e0f/0x74f51638375d4bbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.785952:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b07b3e0f/0x74f51638375d4bbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.785960:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b07b3e0f/0x74f51638375d4bbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.785969:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788536041.786649:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788536041.786665:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002881c563/0x74f51638375d4ba0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786674:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50a00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788536041.786678:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002881c563/0x74f51638375d4ba0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786687:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002881c563/0x74f51638375d4ba0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786708:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002881c563/0x74f51638375d4ba0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786715:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002881c563/0x74f51638375d4ba0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786746:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788536041.786751:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e0857b1/0x74f51638375d4ba7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786758:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50800 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788536041.786761:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e0857b1/0x74f51638375d4ba7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786768:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e0857b1/0x74f51638375d4ba7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786790:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e0857b1/0x74f51638375d4ba7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786798:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e0857b1/0x74f51638375d4ba7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786810:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788536041.786814:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4bae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786820:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a000 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788536041.786823:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4bae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786830:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4bae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786839:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4bae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786847:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4bae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786857:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788536041.786860:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027c43044/0x74f51638375d4bb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786873:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4be00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788536041.786876:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027c43044/0x74f51638375d4bb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786884:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027c43044/0x74f51638375d4bb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786911:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027c43044/0x74f51638375d4bb5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786918:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027c43044/0x74f51638375d4bb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786933:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788536041.786937:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b07b3e0f/0x74f51638375d4bbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786943:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4ba00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788536041.786946:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b07b3e0f/0x74f51638375d4bbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786953:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b07b3e0f/0x74f51638375d4bbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786961:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b07b3e0f/0x74f51638375d4bbc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786974:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b07b3e0f/0x74f51638375d4bbc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.786986:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536041.786988:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536041.786990:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536041.789666:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.789678:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000882e5032/0x74f51638375d4bc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.789694:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.789698:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.789704:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000882e5032/0x74f51638375d4bc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.789716:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000882e5032/0x74f51638375d4bc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.789726:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000882e5032/0x74f51638375d4bc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.789745:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000882e5032/0x74f51638375d4bc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.789775:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788536041.790404:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788536041.790413:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000882e5032/0x74f51638375d4bc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.790422:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b200 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788536041.790427:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000882e5032/0x74f51638375d4bc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.790436:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000882e5032/0x74f51638375d4bc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.790455:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000882e5032/0x74f51638375d4bc3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.790463:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000882e5032/0x74f51638375d4bc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.790483:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536041.790485:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536041.790486:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536041.791246:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.791255:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d59525ff/0x74f51638375d4bca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791268:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.791273:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.791279:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d59525ff/0x74f51638375d4bca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791289:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d59525ff/0x74f51638375d4bca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791297:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d59525ff/0x74f51638375d4bca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791304:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d59525ff/0x74f51638375d4bca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791321:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788536041.791331:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536041.791335:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d59525ff/0x74f51638375d4bca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791342:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4aa00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:2.0:1788536041.791353:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d59525ff/0x74f51638375d4bca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791360:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d59525ff/0x74f51638375d4bca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791372:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d59525ff/0x74f51638375d4bca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791378:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d59525ff/0x74f51638375d4bca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791392:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536041.791394:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536041.791395:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536041.791617:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536041.791823:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.791829:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004403675b/0x74f51638375d4bd1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791838:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.791841:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.791847:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004403675b/0x74f51638375d4bd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791857:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004403675b/0x74f51638375d4bd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791865:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004403675b/0x74f51638375d4bd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791878:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004403675b/0x74f51638375d4bd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.791927:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788536041.792350:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.792356:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b8b5cb9/0x74f51638375d4bd8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.792364:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.792367:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.792372:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b8b5cb9/0x74f51638375d4bd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.792382:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b8b5cb9/0x74f51638375d4bd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.792391:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b8b5cb9/0x74f51638375d4bd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.792398:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b8b5cb9/0x74f51638375d4bd8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.792411:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788536041.792770:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.792776:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f41a2b18/0x74f51638375d4bdf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.792788:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.792791:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536041.792793:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788536041.792795:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f41a2b18/0x74f51638375d4bdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.792799:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004403675b/0x74f51638375d4bd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.792805:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f41a2b18/0x74f51638375d4bdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.792813:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f41a2b18/0x74f51638375d4bdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.792813:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b000 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536041.792817:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004403675b/0x74f51638375d4bd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.792821:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f41a2b18/0x74f51638375d4bdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.792826:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004403675b/0x74f51638375d4bd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.792828:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788536041.792840:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004403675b/0x74f51638375d4bd1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.792848:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004403675b/0x74f51638375d4bd1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.792864:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788536041.792867:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b8b5cb9/0x74f51638375d4bd8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.792874:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a800 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536041.792878:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b8b5cb9/0x74f51638375d4bd8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.793058:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b8b5cb9/0x74f51638375d4bd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.793071:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b8b5cb9/0x74f51638375d4bd8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.793082:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b8b5cb9/0x74f51638375d4bd8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.793095:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536041.793098:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f41a2b18/0x74f51638375d4bdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.793105:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4ae00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536041.793108:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f41a2b18/0x74f51638375d4bdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.793117:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f41a2b18/0x74f51638375d4bdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.793126:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f41a2b18/0x74f51638375d4bdf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.793134:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f41a2b18/0x74f51638375d4bdf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.793144:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536041.793146:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536041.793148:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536041.793181:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.793186:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d4be6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.793198:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.794311:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.794320:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d4be6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.794337:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d4be6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.794361:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d4be6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.794369:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d4be6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.794387:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788536041.794883:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.794909:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7778c50/0x74f51638375d4bed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.794919:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.794922:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.794927:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7778c50/0x74f51638375d4bed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.794936:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7778c50/0x74f51638375d4bed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.794944:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7778c50/0x74f51638375d4bed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.794952:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7778c50/0x74f51638375d4bed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.794969:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788536041.798592:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.798604:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4bf4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.798621:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.798625:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.798632:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4bf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.798645:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4bf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.798656:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4bf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.798663:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4bf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.798673:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788536041.799314:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.799324:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1d6ae0b/0x74f51638375d4bfb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.799334:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.799344:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.799350:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1d6ae0b/0x74f51638375d4bfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.799361:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1d6ae0b/0x74f51638375d4bfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.799370:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1d6ae0b/0x74f51638375d4bfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.799377:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1d6ae0b/0x74f51638375d4bfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.799387:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788536041.799765:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.799772:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4c02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.799781:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.799784:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.799790:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4c02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.799800:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4c02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.799809:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4c02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.799822:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4c02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.799830:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788536041.800609:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.800618:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d4c09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.800627:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.800631:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.800634:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d4c09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.800644:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d4c09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.800652:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d4c09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.800659:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d4c09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.800668:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1788536041.801315:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788536041.801323:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d4be6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801337:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536041.801342:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d4be6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801352:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d4be6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801369:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d4be6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801376:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a3eda0/0x74f51638375d4be6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801397:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788536041.801401:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7778c50/0x74f51638375d4bed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801409:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536041.801412:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7778c50/0x74f51638375d4bed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801419:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7778c50/0x74f51638375d4bed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801427:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7778c50/0x74f51638375d4bed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801440:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7778c50/0x74f51638375d4bed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801459:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788536041.801462:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4bf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801469:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536041.801472:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4bf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801480:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4bf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801490:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4bf4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801497:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bd19f7b/0x74f51638375d4bf4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801509:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788536041.801512:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1d6ae0b/0x74f51638375d4bfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801519:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4bc00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536041.801528:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1d6ae0b/0x74f51638375d4bfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801536:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1d6ae0b/0x74f51638375d4bfb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801546:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1d6ae0b/0x74f51638375d4bfb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801554:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1d6ae0b/0x74f51638375d4bfb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801566:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788536041.801569:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4c02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801575:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b600 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536041.801578:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4c02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801585:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4c02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801607:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4c02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801614:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f48542b6/0x74f51638375d4c02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801630:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536041.801634:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d4c09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801641:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b800 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536041.801643:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d4c09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801650:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d4c09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801658:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d4c09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801666:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9acecc1/0x74f51638375d4c09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536041.801676:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536041.801678:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536041.801680:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536041.801686:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536041.802420:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.802430:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e68c281/0x74f51638375d4c10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.802446:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.802450:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.802456:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e68c281/0x74f51638375d4c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.802468:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e68c281/0x74f51638375d4c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.802477:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e68c281/0x74f51638375d4c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.802484:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e68c281/0x74f51638375d4c10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.802507:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536041.802670:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536041.802678:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e68c281/0x74f51638375d4c10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.802691:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4ac00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788536041.802695:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e68c281/0x74f51638375d4c10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.802703:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e68c281/0x74f51638375d4c10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.802717:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e68c281/0x74f51638375d4c10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.802725:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e68c281/0x74f51638375d4c10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.802752:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536041.802754:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536041.802756:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536041.804472:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.804485:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d4c17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.804499:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.804503:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.804510:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d4c17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.804522:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d4c17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.804542:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d4c17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.804550:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d4c17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.804579:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536041.804842:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536041.804851:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d4c17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.804872:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a600 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788536041.804877:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d4c17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.804905:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d4c17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.804929:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d4c17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.804938:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ba298dd/0x74f51638375d4c17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.804959:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536041.804962:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536041.804965:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536041.806533:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.806547:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4c1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.806563:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.806568:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.806574:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4c1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.806589:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4c1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.806598:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4c1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.806606:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4c1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.806647:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536041.806721:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536041.806729:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4c1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.806748:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a000 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788536041.806754:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4c1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.806764:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4c1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.806783:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4c1e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.806790:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7d31400/0x74f51638375d4c1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.806837:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536041.806839:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536041.806841:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536041.808677:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.808689:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f042ba6/0x74f51638375d4c25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.808703:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.808707:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.808714:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f042ba6/0x74f51638375d4c25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.808728:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f042ba6/0x74f51638375d4c25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.808748:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f042ba6/0x74f51638375d4c25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.808756:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f042ba6/0x74f51638375d4c25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.809784:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788536041.810344:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.810352:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fcad334/0x74f51638375d4c2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.810365:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.810375:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.810380:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fcad334/0x74f51638375d4c2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.810393:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fcad334/0x74f51638375d4c2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.810402:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fcad334/0x74f51638375d4c2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.810408:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fcad334/0x74f51638375d4c2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.814541:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788536041.814556:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f042ba6/0x74f51638375d4c25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.814570:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fc00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788536041.814575:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f042ba6/0x74f51638375d4c25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.814587:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f042ba6/0x74f51638375d4c25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.814608:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f042ba6/0x74f51638375d4c25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.814616:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f042ba6/0x74f51638375d4c25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.814645:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788536041.814649:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fcad334/0x74f51638375d4c2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.814655:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788536041.814658:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fcad334/0x74f51638375d4c2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.814665:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fcad334/0x74f51638375d4c2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.814695:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fcad334/0x74f51638375d4c2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536041.814702:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536041.814704:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536041.814706:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536041.822304:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788536041.822320:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fcad334/0x74f51638375d4c2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.823940:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536041.825908:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.825922:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c060efb8/0x74f51638375d4c33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.825939:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.825943:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.825950:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c060efb8/0x74f51638375d4c33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.825964:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c060efb8/0x74f51638375d4c33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.825982:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c060efb8/0x74f51638375d4c33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.825990:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c060efb8/0x74f51638375d4c33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.826025:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536041.826097:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536041.826104:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c060efb8/0x74f51638375d4c33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.826113:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f600 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788536041.826118:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c060efb8/0x74f51638375d4c33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.826128:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c060efb8/0x74f51638375d4c33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.826145:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c060efb8/0x74f51638375d4c33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.826153:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c060efb8/0x74f51638375d4c33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.826173:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536041.826175:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536041.826177:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536041.827678:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.827688:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9299cd4/0x74f51638375d4c3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.827701:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.827704:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.827710:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9299cd4/0x74f51638375d4c3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.827722:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9299cd4/0x74f51638375d4c3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.827742:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9299cd4/0x74f51638375d4c3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.827750:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9299cd4/0x74f51638375d4c3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.827780:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536041.829792:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536041.829804:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9299cd4/0x74f51638375d4c3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.829830:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788536041.829835:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9299cd4/0x74f51638375d4c3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.829845:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9299cd4/0x74f51638375d4c3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.829864:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9299cd4/0x74f51638375d4c3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.829871:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9299cd4/0x74f51638375d4c3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.829907:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536041.829909:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536041.829911:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536041.830113:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788536041.830120:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2acb4d2/0x74f51638375d4c41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.830131:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788536041.830135:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536041.830141:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2acb4d2/0x74f51638375d4c41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.830151:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2acb4d2/0x74f51638375d4c41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.830159:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2acb4d2/0x74f51638375d4c41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.830166:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2acb4d2/0x74f51638375d4c41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.830186:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788536041.830196:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536041.830200:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2acb4d2/0x74f51638375d4c41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.830207:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ec00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:2.0:1788536041.830215:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2acb4d2/0x74f51638375d4c41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.830224:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2acb4d2/0x74f51638375d4c41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.830234:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2acb4d2/0x74f51638375d4c41 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.830241:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2acb4d2/0x74f51638375d4c41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.830253:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536041.830254:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536041.830256:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788536041.830487:0:15003:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1788536041.830579:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b740aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14343:x1875415607113216:12345-0@lo:5:osp-pre-0-0.0 Request processed in 73145us (74132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536041.830589:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788536041.830638:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14343:1875415607113216:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788536041.830653:0:14343:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1788536041.830695:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14343:1875415607113600:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788536041.830729:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536041.831510:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987bc03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788536041.832881:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607113600 00000100:00100000:3.0:1788536041.832907:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607113600 00000100:00100000:3.0:1788536041.832980:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788536041.832989:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14343:x1875415607113600:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788536041.833036:0:15003:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788536041.841045:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14343:x1875415607113600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8050us (10309us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788536041.841115:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788536041.841468:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14343:1875415607113600:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788536041.841486:0:14343:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:0.0:1788536041.841949:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 20000000:01000000:2.0:1788536041.894633:0:14314:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788536041.894652:0:14314:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788536041.894708:0:14336:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788536041.894713:0:14336:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788536041.894742:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.894760:0:14336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a980030200/0x74f51638375d4b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4b14 expref: 19 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.894769:0:14336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.894825:0:14336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a980030200/0x74f51638375d4b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d4b14 expref: 19 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.894839:0:14336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a980030200/0x74f51638375d4b1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d4b14 expref: 19 pid: 14314 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536041.894865:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7417b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14336:1875415607113728:0@lo:104: 00000100:00100000:1.0:1788536041.894939:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536041.894990:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99114a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788536041.895097:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607113728 00000100:00100000:2.0:1788536041.895105:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607113728 00000100:00100000:2.0:1788536041.895143:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788536041.895151:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49edad1-b206-4ca7-85f1-c4b27706521e+3:14336:x1875415607113728:12345-0@lo:104: 00010000:00010000:2.0:1788536041.895164:0:14304:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4b1b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536041.895219:0:14304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788536041.895225:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c49edad1-b206-4ca7-85f1-c4b27706521e+3:14336:x1875415607113728:12345-0@lo:104: Request processed in 75us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536041.895232:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788536041.895458:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536041.895464:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4b1b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895472:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9bfc50c00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:1.0:1788536041.895475:0:14308:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d4b1b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895484:0:14308:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d4b1b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788536041.895492:0:14308:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d4b1b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536041.895497:0:14308:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788536041.895522:0:14308:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4b1b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895528:0:14308:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788536041.895543:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4b1b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895557:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9bfc50c00/0x74f51638375d4b14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4b1b expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895573:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536041.895574:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536041.895576:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788536041.895592:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49edad1-b206-4ca7-85f1-c4b27706521e:3310:1875415607113856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788536041.895618:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536041.895653:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607113856 00000100:00100000:1.0:1788536041.895657:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607113856 00010000:00010000:1.0:1788536041.895674:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a980030200/0x74f51638375d4b1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4b14 expref: 20 pid: 14314 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536041.895697:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788536041.895703:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49edad1-b206-4ca7-85f1-c4b27706521e+20:3310:x1875415607113856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788536041.895712:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788536041.895717:0:14307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a980030200/0x74f51638375d4b1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4b14 expref: 20 pid: 14314 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895728:0:14307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a980030200/0x74f51638375d4b1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d4b14 expref: 20 pid: 14314 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895752:0:14307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895760:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788536041.895772:0:14307:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001847706s 00010000:00010000:1.0:1788536041.895781:0:14307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895788:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895795:0:14307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895801:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895806:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788536041.895811:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895817:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895825:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.895833:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788536041.895945:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49edad1-b206-4ca7-85f1-c4b27706521e+20:3310:x1875415607113856:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536041.895952:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788536041.895984:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49edad1-b206-4ca7-85f1-c4b27706521e:3310:1875415607113856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788536041.896079:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a980030200/0x74f51638375d4b1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d4b14 expref: 19 pid: 14314 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536041.896089:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7417b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14336:1875415607113728:0@lo:104: 00010000:00010000:1.0:1788536041.896105:0:14336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.896114:0:14336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.896120:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536041.896126:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4c48 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536041.911922:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+18:15716:x1875415607113472:12345-0@lo:253:mount.lustre.0 Request processed in 135135us (136313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536041.911937:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788536041.912019:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7408380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c49edad1-b206-4ca7-85f1-c4b27706521e:15716:1875415607113472:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788536041.912037:0:15716:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788536041.912040:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788536041.912042:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788536041.912043:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788536041.912044:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788536041.912045:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788536041.912047:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788536041.912048:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788536041.912050:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788536041.912051:0:15716:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788536041.912064:0:15716:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788536041.920809:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788536041.921060:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788536041.921219:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788536041.921371:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788536041.921508:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788536041.921705:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788536041.927474:0:15716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788536042.031572:0:15716:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788536042.031582:0:15716:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788536042.031633:0:15716:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788536042.031746:0:15716:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788536042.031771:0:15716:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788536042.031798:0:15716:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788536042.765037:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536043.790395:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788536043.858735:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788536043.858755:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:3.0:1788536043.917386:0:14317:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788536043.917393:0:14317:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a988040000 from 8 10000000:01000000:3.0:1788536043.917398:0:14317:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788536043.917452:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d4c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536043.917464:0:14317:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d4c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536043.917476:0:14317:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d4c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536043.917503:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf769180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607113984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788536043.917745:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536043.917788:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9924cb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788536043.917869:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607113984 00000100:00100000:2.0:1788536043.917877:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607113984 00000100:00100000:2.0:1788536043.917960:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788536043.917971:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+18:14317:x1875415607113984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788536043.917983:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536043.917996:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b747e200/0x74f51638375d4c56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4c4f expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536043.918019:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b747e200/0x74f51638375d4c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4c4f expref: 19 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536043.918030:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b747e200/0x74f51638375d4c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4c4f expref: 19 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536043.918038:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747e200, rc 0) 00000100:00100000:2.0:1788536043.918075:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+19:14317:x1875415607113984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536043.918081:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788536043.918140:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf769180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607113984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788536043.918154:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d4c4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4c56 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536043.918164:0:14317:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d4c4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4c56 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536043.918210:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf769180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607114112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788536043.918237:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536043.918407:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9924cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788536043.919026:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607114112 00000100:00100000:0.0:1788536043.919098:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607114112 00000100:00100000:0.0:1788536043.919387:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788536043.919397:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+19:14317:x1875415607114112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788536043.919416:0:14314:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788536043.919857:0:14314:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788536043.919862:0:14314:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788536043.920920:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+19:14317:x1875415607114112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1518us (2674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536043.920931:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788536043.921319:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf769180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607114112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788536043.921384:0:14317:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788536043.921394:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d4c4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4c56 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536043.921409:0:14317:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a980031400/0x74f51638375d4c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4c56 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536044.822294:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536045.837219:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536046.865202:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49edad1-b206-4ca7-85f1-c4b27706521e:3311:1875415607114240:0@lo:400:kworker.0 00000100:00100000:2.0:1788536046.865277:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788536046.865425:0:13881:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536046.865429:0:13881:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788536046.865444:0:13881:0:(import.c:65:import_set_state_nolock()) ffff97a987bbc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788536046.865452:0:13881:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a987bbc000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788536046.865474:0:13881:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a9b7414a80 x1875415607114496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788536046.865810:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788536046.865818:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607114752:0@lo:400:kworker.0 00000100:00100000:2.0:1788536046.865849:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536046.865919:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607114240 00000100:00100000:2.0:1788536046.865927:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607114240 00000100:00100000:2.0:1788536046.865977:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788536046.865995:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+19:3311:x1875415607114240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536046.866046:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+19:3311:x1875415607114240:12345-0@lo:400:kworker.0 Request processed in 54us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536046.866053:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788536046.866083:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607114752 00000100:00100000:2.0:1788536046.866087:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607114752 00000100:00100000:2.0:1788536046.866125:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788536046.866132:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607114752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536046.866160:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607114752:12345-0@lo:400:kworker.0 Request processed in 30us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536046.866166:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788536046.866184:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788536046.866218:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b7415880 x1875415607114752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536046.866231:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607114752:0@lo:400:kworker.0 00000100:00100000:2.0:1788536046.866243:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49edad1-b206-4ca7-85f1-c4b27706521e:3311:1875415607114240:0@lo:400:kworker.0 00000100:00100000:1.0:1788536046.867021:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788536046.867034:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607114880:0@lo:400:kworker.0 00000100:00100000:1.0:1788536046.867077:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536046.867112:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607114368:0@lo:400:kworker.0 00000100:00100000:1.0:1788536046.867138:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536046.867157:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788536046.867163:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607114624:0@lo:400:kworker.0 00000100:00100000:1.0:1788536046.867185:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536046.867211:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607114496:0@lo:8:kworker.0 00000100:00100000:1.0:1788536046.867231:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536046.867259:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607114880 00000100:00100000:1.0:1788536046.867265:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607114880 00000100:00100000:1.0:1788536046.867302:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607114624 00000100:00100000:1.0:1788536046.867305:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607114624 00000100:00100000:1.0:1788536046.867449:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788536046.867457:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607114880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536046.867511:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607114880:12345-0@lo:400:kworker.0 Request processed in 55us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536046.867519:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788536046.867535:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788536046.867541:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607114624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536046.867573:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607114624:12345-0@lo:400:kworker.0 Request processed in 32us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536046.867589:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788536046.868369:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b7415500 x1875415607114880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536046.868384:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607114880:0@lo:400:kworker.0 00000100:00100000:1.0:1788536046.869432:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607114368 00000100:00100000:1.0:1788536046.869444:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607114368 00000100:00100000:1.0:1788536046.869503:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607114496 00000100:00100000:1.0:1788536046.869506:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607114496 00000100:00100000:1.0:1788536046.869524:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788536046.869532:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607114368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536046.869601:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607114368:12345-0@lo:400:kworker.0 Request processed in 71us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536046.869609:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788536046.869625:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788536046.869629:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875415607114496:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788536046.869653:0:15005:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1788536046.869683:0:15005:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74f51638375d4c5d 00002000:00100000:1.0:1788536046.869696:0:15005:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97a9924a3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788536046.869721:0:15005:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788536046.869723:0:15005:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1788536046.870968:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788536046.870976:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:1.0:1788536046.871195:0:15005:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788536046.871223:0:15005:0:(import.c:65:import_set_state_nolock()) ffff97a9924a5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788536046.871348:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875415607114496:12345-0@lo:8:kworker.0 Request processed in 1716us (4114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536046.871356:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788536046.871411:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b7416680 x1875415607114624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536046.871426:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607114624:0@lo:400:kworker.0 00000100:00100000:1.0:1788536046.871457:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788536046.871472:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607114368:0@lo:400:kworker.0 00010000:00010000:0.0:1788536046.871856:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788536046.875264:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b7414a80 x1875415607114496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788536066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788536046.875286:0:3307:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788536046.875294:0:3307:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788536046.875310:0:3307:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788536046.875314:0:3307:0:(import.c:65:import_set_state_nolock()) ffff97a987bbc000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788536046.875326:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788536046.875332:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875415607114496:0@lo:8:kworker.0 00000004:00080000:2.0:1788536046.875364:0:14344:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788536046.875903:0:14345:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788536046.875926:0:14345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14345:1875415607115264:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788536046.875989:0:14345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536046.876016:0:14345:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a986a19180 going to sleep for 11 seconds 00000100:00100000:0.0:1788536046.876037:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607115264 00000100:00100000:0.0:1788536046.876043:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607115264 00000100:00100000:0.0:1788536046.876092:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788536046.876100:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14345:x1875415607115264:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788536046.878417:0:15003:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788536046.878428:0:15003:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788536046.878432:0:15003:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000004:00080000:2.0:1788536046.881000:0:14344:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 449012109946ns, next at 0ns, rc = 0 00000100:00080000:2.0:1788536046.883032:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788536046.883601:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607115136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788536046.883668:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536046.883719:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788536046.883726:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607115008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788536046.883751:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536046.883800:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607115136 00000100:00100000:1.0:1788536046.883808:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607115136 00000100:00100000:1.0:1788536046.883840:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607115008 00000100:00100000:1.0:1788536046.883843:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607115008 00000100:00100000:1.0:1788536046.883857:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788536046.883864:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875415607115136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788536046.884148:0:15006:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788536046.884194:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875415607115136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 329us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536046.884202:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788536046.884219:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788536046.884225:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607115008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788536046.884241:0:15006:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788536046.884269:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607115008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536046.884274:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788536046.884532:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607115008:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788536046.884545:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a9b6ac2680 x1875415607115136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788536062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536046.884570:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607115136:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1788536046.898024:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.898037:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4c64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.898068:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.898073:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.898080:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.898100:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.898111:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.898119:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.898137:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788536046.898585:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.898591:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c51c31ef/0x74f51638375d4c6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.898600:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.898603:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.898608:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c51c31ef/0x74f51638375d4c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.898617:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c51c31ef/0x74f51638375d4c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.898636:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c51c31ef/0x74f51638375d4c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.898643:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c51c31ef/0x74f51638375d4c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.898656:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788536046.899043:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.899049:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007669088f/0x74f51638375d4c72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899057:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.899060:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.899065:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007669088f/0x74f51638375d4c72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899075:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007669088f/0x74f51638375d4c72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899083:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007669088f/0x74f51638375d4c72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899090:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007669088f/0x74f51638375d4c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899108:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788536046.899472:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.899478:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096585e24/0x74f51638375d4c79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899486:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.899489:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.899493:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096585e24/0x74f51638375d4c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899503:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096585e24/0x74f51638375d4c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899511:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096585e24/0x74f51638375d4c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899518:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096585e24/0x74f51638375d4c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899527:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788536046.899926:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.899932:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000547d839c/0x74f51638375d4c80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899940:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.899950:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.899954:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000547d839c/0x74f51638375d4c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899963:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000547d839c/0x74f51638375d4c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899971:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000547d839c/0x74f51638375d4c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899978:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000547d839c/0x74f51638375d4c80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.899986:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788536046.900370:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.900376:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d4c87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.900384:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.900387:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.900391:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d4c87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.900400:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d4c87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.900408:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d4c87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.900420:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d4c87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.900428:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788536046.901361:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.901370:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4573987/0x74f51638375d4c8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.901381:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.901384:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.901388:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4573987/0x74f51638375d4c8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.901399:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4573987/0x74f51638375d4c8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.901408:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4573987/0x74f51638375d4c8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.901414:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4573987/0x74f51638375d4c8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.901423:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788536046.901867:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.901873:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007402308d/0x74f51638375d4c95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.901905:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.901909:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.901913:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007402308d/0x74f51638375d4c95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.901924:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007402308d/0x74f51638375d4c95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.901931:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007402308d/0x74f51638375d4c95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.901938:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007402308d/0x74f51638375d4c95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.901946:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1788536046.902314:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.902320:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f676342a/0x74f51638375d4c9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.902328:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.902330:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.902334:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f676342a/0x74f51638375d4c9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.902343:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f676342a/0x74f51638375d4c9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.902362:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f676342a/0x74f51638375d4c9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.902368:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f676342a/0x74f51638375d4c9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.902376:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1788536046.902754:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.902760:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d4ca3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.902767:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.902770:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.902774:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d4ca3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.902783:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d4ca3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.902790:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d4ca3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.902797:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d4ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.902815:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1788536046.903185:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.903191:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6ad9b49/0x74f51638375d4caa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.903199:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.903202:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.903206:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6ad9b49/0x74f51638375d4caa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.903215:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6ad9b49/0x74f51638375d4caa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.903223:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6ad9b49/0x74f51638375d4caa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.903230:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6ad9b49/0x74f51638375d4caa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.903238:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1788536046.903619:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.903625:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4cb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.903633:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.903640:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.903644:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.903654:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.903662:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.903669:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.903676:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:0.0:1788536046.904077:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.904082:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006377cd3/0x74f51638375d4cb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.904089:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.904092:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.904096:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006377cd3/0x74f51638375d4cb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.904105:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006377cd3/0x74f51638375d4cb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.904111:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006377cd3/0x74f51638375d4cb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.904123:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006377cd3/0x74f51638375d4cb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.904131:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:0.0:1788536046.905681:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.905691:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d31400/0x74f51638375d4cbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.905717:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.905721:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.905727:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d31400/0x74f51638375d4cbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.905739:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7d31400/0x74f51638375d4cbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.905748:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d31400/0x74f51638375d4cbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.905755:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d31400/0x74f51638375d4cbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.905765:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:0.0:1788536046.906253:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.906260:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d4cc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.906274:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.906278:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.906283:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d4cc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.906294:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d4cc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.906303:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d4cc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.906310:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d4cc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.906319:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:0.0:1788536046.906678:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.906684:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d4ccd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.906693:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.906709:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.906714:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d4ccd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.906724:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d4ccd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.906744:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d4ccd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.906752:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d4ccd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.906759:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:0.0:1788536046.907152:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.907158:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4cd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.907509:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.907513:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.907518:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.907529:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.907538:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.907546:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4cd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.907566:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:0.0:1788536046.908075:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.908081:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f48542b6/0x74f51638375d4cdb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.908089:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.908092:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.908096:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f48542b6/0x74f51638375d4cdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.908105:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f48542b6/0x74f51638375d4cdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.908113:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f48542b6/0x74f51638375d4cdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.908120:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f48542b6/0x74f51638375d4cdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.908128:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:0.0:1788536046.908541:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.908546:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1d6ae0b/0x74f51638375d4ce2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.908554:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.908561:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.908566:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1d6ae0b/0x74f51638375d4ce2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.908575:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1d6ae0b/0x74f51638375d4ce2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.908583:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1d6ae0b/0x74f51638375d4ce2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.908590:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1d6ae0b/0x74f51638375d4ce2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.908597:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:0.0:1788536046.909277:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.909284:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bd19f7b/0x74f51638375d4ce9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.909294:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.909297:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.909302:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd19f7b/0x74f51638375d4ce9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.909311:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd19f7b/0x74f51638375d4ce9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.909319:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bd19f7b/0x74f51638375d4ce9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.909331:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bd19f7b/0x74f51638375d4ce9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.909340:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:0.0:1788536046.909683:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.909689:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7778c50/0x74f51638375d4cf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.909708:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.909712:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.909716:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7778c50/0x74f51638375d4cf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.909725:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7778c50/0x74f51638375d4cf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.909733:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7778c50/0x74f51638375d4cf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.909739:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7778c50/0x74f51638375d4cf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.909747:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00010000:00010000:0.0:1788536046.910242:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:0.0:1788536046.910251:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910265:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecac00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910269:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910278:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4c64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910294:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4c64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910301:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038dcf00f/0x74f51638375d4c64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910318:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:0.0:1788536046.910321:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c51c31ef/0x74f51638375d4c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910327:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910330:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c51c31ef/0x74f51638375d4c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910337:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c51c31ef/0x74f51638375d4c6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910346:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c51c31ef/0x74f51638375d4c6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910358:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c51c31ef/0x74f51638375d4c6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910368:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:0.0:1788536046.910372:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007669088f/0x74f51638375d4c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910377:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb000 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910380:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007669088f/0x74f51638375d4c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910387:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007669088f/0x74f51638375d4c72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910394:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007669088f/0x74f51638375d4c72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910401:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007669088f/0x74f51638375d4c72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910409:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:0.0:1788536046.910412:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096585e24/0x74f51638375d4c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910417:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecbe00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910423:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096585e24/0x74f51638375d4c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910431:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096585e24/0x74f51638375d4c79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910439:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096585e24/0x74f51638375d4c79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910445:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096585e24/0x74f51638375d4c79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910456:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:0.0:1788536046.910459:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000547d839c/0x74f51638375d4c80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910464:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecae00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910467:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000547d839c/0x74f51638375d4c80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910474:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000547d839c/0x74f51638375d4c80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910482:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000547d839c/0x74f51638375d4c80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910488:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000547d839c/0x74f51638375d4c80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910503:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1788536046.910506:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d4c87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910513:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecbc00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910516:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d4c87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910523:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d4c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910532:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d4c87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910539:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6186e33/0x74f51638375d4c87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910549:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1788536046.910553:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4573987/0x74f51638375d4c8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910559:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecba00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910562:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4573987/0x74f51638375d4c8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910578:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4573987/0x74f51638375d4c8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910587:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4573987/0x74f51638375d4c8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910594:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4573987/0x74f51638375d4c8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910605:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1788536046.910608:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007402308d/0x74f51638375d4c95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910615:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb800 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910618:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007402308d/0x74f51638375d4c95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910626:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007402308d/0x74f51638375d4c95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910634:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007402308d/0x74f51638375d4c95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910640:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007402308d/0x74f51638375d4c95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910661:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788536046.910665:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f676342a/0x74f51638375d4c9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910670:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecb600 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910673:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f676342a/0x74f51638375d4c9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910681:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f676342a/0x74f51638375d4c9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910691:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f676342a/0x74f51638375d4c9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910711:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f676342a/0x74f51638375d4c9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910721:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788536046.910725:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d4ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910731:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987ecaa00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910734:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d4ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910752:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d4ca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910762:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d4ca3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910768:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f502873/0x74f51638375d4ca3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910780:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788536046.910783:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6ad9b49/0x74f51638375d4caa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910788:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca200 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910792:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6ad9b49/0x74f51638375d4caa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910799:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6ad9b49/0x74f51638375d4caa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910808:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6ad9b49/0x74f51638375d4caa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910815:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6ad9b49/0x74f51638375d4caa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910836:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788536046.910839:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910845:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca800 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910848:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910855:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4cb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910863:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4cb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910870:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b90f9c51/0x74f51638375d4cb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910880:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788536046.910884:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006377cd3/0x74f51638375d4cb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910916:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a987eca400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910919:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006377cd3/0x74f51638375d4cb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910936:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006377cd3/0x74f51638375d4cb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910946:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006377cd3/0x74f51638375d4cb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910953:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006377cd3/0x74f51638375d4cb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910965:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788536046.910968:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7d31400/0x74f51638375d4cbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910974:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a000 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.910977:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d31400/0x74f51638375d4cbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910984:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d31400/0x74f51638375d4cbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.910993:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7d31400/0x74f51638375d4cbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911000:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7d31400/0x74f51638375d4cbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911020:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788536046.911024:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d4cc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911031:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a600 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.911034:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d4cc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911041:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d4cc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911051:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d4cc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911058:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ba298dd/0x74f51638375d4cc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911069:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788536046.911072:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d4ccd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911078:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4ac00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.911081:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d4ccd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911097:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d4ccd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911106:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d4ccd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911113:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e68c281/0x74f51638375d4ccd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911125:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788536046.911129:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4cd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911135:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b800 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.911137:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4cd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911146:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4cd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911154:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4cd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.911160:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9acecc1/0x74f51638375d4cd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912511:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788536046.912517:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f48542b6/0x74f51638375d4cdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912525:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b600 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.912529:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f48542b6/0x74f51638375d4cdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912538:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f48542b6/0x74f51638375d4cdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912554:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f48542b6/0x74f51638375d4cdb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912561:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f48542b6/0x74f51638375d4cdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912572:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788536046.912576:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1d6ae0b/0x74f51638375d4ce2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912582:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4bc00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.912585:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1d6ae0b/0x74f51638375d4ce2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912603:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1d6ae0b/0x74f51638375d4ce2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912612:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1d6ae0b/0x74f51638375d4ce2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912620:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1d6ae0b/0x74f51638375d4ce2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912632:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788536046.912635:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bd19f7b/0x74f51638375d4ce9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912641:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.912644:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bd19f7b/0x74f51638375d4ce9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912652:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bd19f7b/0x74f51638375d4ce9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912660:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bd19f7b/0x74f51638375d4ce9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912668:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd19f7b/0x74f51638375d4ce9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912712:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536046.912716:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7778c50/0x74f51638375d4cf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912723:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.912726:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7778c50/0x74f51638375d4cf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912734:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7778c50/0x74f51638375d4cf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912744:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7778c50/0x74f51638375d4cf0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912751:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7778c50/0x74f51638375d4cf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.912761:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536046.912763:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536046.912765:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536046.912773:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536046.913336:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.913343:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a3eda0/0x74f51638375d4cf7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.913355:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.913363:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.913370:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059a3eda0/0x74f51638375d4cf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.913382:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059a3eda0/0x74f51638375d4cf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.913392:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a3eda0/0x74f51638375d4cf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.913400:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059a3eda0/0x74f51638375d4cf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.913420:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536046.913432:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536046.913436:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059a3eda0/0x74f51638375d4cf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.913443:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a400 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.913447:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a3eda0/0x74f51638375d4cf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.913455:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a3eda0/0x74f51638375d4cf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.913466:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059a3eda0/0x74f51638375d4cf7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.913484:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059a3eda0/0x74f51638375d4cf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.913499:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536046.913500:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536046.913502:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536046.915422:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.915437:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882e5032/0x74f51638375d4cfe lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.915454:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.915458:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.915464:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000882e5032/0x74f51638375d4cfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.915476:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000882e5032/0x74f51638375d4cfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.915486:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882e5032/0x74f51638375d4cfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.915494:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000882e5032/0x74f51638375d4cfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.915510:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536046.915522:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536046.915532:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000882e5032/0x74f51638375d4cfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.915539:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b200 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.915544:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000882e5032/0x74f51638375d4cfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.915552:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000882e5032/0x74f51638375d4cfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.915566:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000882e5032/0x74f51638375d4cfe lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.915573:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000882e5032/0x74f51638375d4cfe lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.915590:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536046.915593:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536046.915595:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536046.916082:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.916088:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b07b3e0f/0x74f51638375d4d05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.916096:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.916100:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.916103:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b07b3e0f/0x74f51638375d4d05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.916123:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b07b3e0f/0x74f51638375d4d05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.916132:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b07b3e0f/0x74f51638375d4d05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.916139:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b07b3e0f/0x74f51638375d4d05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.916153:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536046.916163:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536046.917748:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b07b3e0f/0x74f51638375d4d05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.917760:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4ba00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.917765:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b07b3e0f/0x74f51638375d4d05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.917774:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b07b3e0f/0x74f51638375d4d05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.917901:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b07b3e0f/0x74f51638375d4d05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.917912:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b07b3e0f/0x74f51638375d4d05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.917942:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536046.917944:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536046.917946:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536046.918638:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.918648:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027c43044/0x74f51638375d4d0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.918660:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.918664:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.918670:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027c43044/0x74f51638375d4d0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.918683:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027c43044/0x74f51638375d4d0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.918692:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027c43044/0x74f51638375d4d0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.918712:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027c43044/0x74f51638375d4d0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.918732:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788536046.919428:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.919436:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d4d13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919460:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.919463:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.919469:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d4d13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919480:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d4d13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919489:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d4d13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919498:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d4d13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919512:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788536046.919523:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788536046.919528:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027c43044/0x74f51638375d4d0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919536:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4be00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.919540:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027c43044/0x74f51638375d4d0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919549:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027c43044/0x74f51638375d4d0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919577:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027c43044/0x74f51638375d4d0c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919585:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027c43044/0x74f51638375d4d0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919601:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536046.919605:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d4d13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919612:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4aa00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.919615:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d4d13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919623:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d4d13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919632:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d4d13 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919640:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d59525ff/0x74f51638375d4d13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.919652:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536046.919653:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536046.919661:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536046.920981:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536046.922043:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788536046.922053:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f41a2b18/0x74f51638375d4d1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.922069:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788536046.922074:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536046.922081:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f41a2b18/0x74f51638375d4d1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.922094:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f41a2b18/0x74f51638375d4d1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.922105:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f41a2b18/0x74f51638375d4d1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.922113:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f41a2b18/0x74f51638375d4d1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.922128:0:15003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536046.922138:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536046.922144:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f41a2b18/0x74f51638375d4d1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.922151:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4ae00 already unused, calling callback (ffffffffc1455530) 00010000:00010000:0.0:1788536046.922155:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f41a2b18/0x74f51638375d4d1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.922177:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f41a2b18/0x74f51638375d4d1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.922192:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f41a2b18/0x74f51638375d4d1a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.922201:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f41a2b18/0x74f51638375d4d1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536046.922224:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536046.922226:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536046.922228:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788536046.922471:0:15003:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1788536046.922566:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14345:x1875415607115264:12345-0@lo:5:osp-pre-1-0.0 Request processed in 46463us (46573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536046.922576:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788536046.922693:0:14345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14345:1875415607115264:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788536046.922719:0:14345:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788536046.922763:0:14345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14345:1875415607115392:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788536046.922801:0:14345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536046.922839:0:14345:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9bea573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788536046.923040:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607115392 00000100:00100000:1.0:1788536046.923048:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607115392 00000100:00100000:1.0:1788536046.923125:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788536046.923136:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14345:x1875415607115392:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788536046.923177:0:15005:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:0.0:1788536046.926554:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788536046.935076:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14345:x1875415607115392:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11931us (12265us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788536046.935090:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788536046.935479:0:14345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14345:1875415607115392:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788536046.935496:0:14345:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00080000:3.0:1788536047.526245:0:7609:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788536047.527126:0:7609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788536047.889402:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788536048.145302:0:14353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788536048.367651:0:16073:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788536048.910009:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536049.933288:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536050.454150:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536050.454181:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589297152 00000100:00100000:2.0:1788536050.454190:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589297152 00000100:00100000:2.0:1788536050.454227:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:2.0:1788536050.454235:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2354:x1875415589297152:12345-192.168.203.12@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788536050.454261:0:14314:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2232579b-d1e7-484c-9edd-a2aa5d8e2a6c@192.168.203.12@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1788536050.454288:0:14314:0:(genops.c:1385:class_connect()) connect: client 2232579b-d1e7-484c-9edd-a2aa5d8e2a6c, cookie 0x74f51638375d4d21 00000100:00080000:2.0:1788536050.454423:0:14314:0:(import.c:65:import_set_state_nolock()) ffff97a9bf1c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788536050.454484:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+5:2354:x1875415589297152:12345-192.168.203.12@tcp:250:mount.lustre.0 Request processed in 248us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536050.454492:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:3.0:1788536050.464973:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536050.465056:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589297280 00000100:00100000:2.0:1788536050.465066:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589297280 00000100:00100000:2.0:1788536050.465126:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:2.0:1788536050.465137:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+5:13745:x1875415589297280:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788536050.465165:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536050.465183:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b747fa00/0x74f51638375d4d28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515a11 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536050.465337:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b747fa00/0x74f51638375d4d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a11 expref: 6 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536050.465349:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b747fa00/0x74f51638375d4d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a11 expref: 6 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536050.465358:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747fa00, rc 0) 00000100:00100000:2.0:1788536050.465417:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+6:13745:x1875415589297280:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 282us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536050.465424:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:2.0:1788536050.475354:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536050.476129:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589297408 00000100:00100000:0.0:1788536050.476152:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589297408 00000100:00100000:0.0:1788536050.476214:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:0.0:1788536050.476224:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+6:13745:x1875415589297408:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788536050.476621:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+6:13745:x1875415589297408:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 396us (1275us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788536050.476630:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1788536050.481785:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536050.482147:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589297536 00000100:00100000:3.0:1788536050.482157:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589297536 00000100:00100000:3.0:1788536050.482249:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:3.0:1788536050.482260:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9a7d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+6:13745:x1875415589297536:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788536050.482276:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536050.482292:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a980031c00/0x74f51638375d4d2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515a18 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536050.482336:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a980031c00/0x74f51638375d4d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a18 expref: 7 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536050.482348:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a980031c00/0x74f51638375d4d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a18 expref: 7 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536050.482357:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980031c00, rc 0) 00000100:00100000:3.0:1788536050.482422:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9a7d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+7:13745:x1875415589297536:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 164us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536050.482429:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:1.0:1788536050.485226:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536050.485406:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589297664 00000100:00100000:2.0:1788536050.485416:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589297664 00000100:00100000:2.0:1788536050.485501:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:2.0:1788536050.485511:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+7:13745:x1875415589297664:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788536050.485829:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+8:13745:x1875415589297664:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 318us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536050.485837:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:2.0:1788536050.488020:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536050.488230:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589297792 00000100:00100000:3.0:1788536050.488239:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589297792 00000100:00100000:3.0:1788536050.488334:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:3.0:1788536050.488344:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986e9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+8:13745:x1875415589297792:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788536050.488761:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986e9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+8:13745:x1875415589297792:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 416us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536050.488771:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1788536050.496464:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536050.497198:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589297920 00000100:00100000:2.0:1788536050.497209:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589297920 00000100:00100000:2.0:1788536050.497257:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:2.0:1788536050.497267:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+8:13764:x1875415589297920:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788536050.497638:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+8:13764:x1875415589297920:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 371us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536050.497647:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1788536050.506233:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536050.506291:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589298048 00000100:00100000:3.0:1788536050.506301:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589298048 00000100:00100000:3.0:1788536050.506353:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:3.0:1788536050.506362:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+8:13764:x1875415589298048:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788536050.506759:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+8:13764:x1875415589298048:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 396us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536050.506767:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:3.0:1788536050.512318:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536050.512737:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589298176 00000100:00100000:0.0:1788536050.512750:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589298176 00000100:00100000:0.0:1788536050.512809:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:0.0:1788536050.512819:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+8:13745:x1875415589298176:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788536050.512836:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536050.512855:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a98ab4bc00/0x74f51638375d4d36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515a42 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536050.512925:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4bc00/0x74f51638375d4d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a42 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536050.512939:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a98ab4bc00/0x74f51638375d4d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a42 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536050.512949:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4bc00, rc 0) 00000100:00100000:0.0:1788536050.513011:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+9:13745:x1875415589298176:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 193us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536050.513018:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1788536050.523663:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536050.523759:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589298304 00000100:00100000:3.0:1788536050.523770:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589298304 00000100:00100000:3.0:1788536050.523823:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:3.0:1788536050.523833:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+9:13745:x1875415589298304:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788536050.523859:0:14314:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788536050.523882:0:14314:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788536050.523926:0:14314:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788536050.523931:0:14314:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788536050.523934:0:14314:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788536050.530985:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+9:13745:x1875415589298304:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 7139us (7318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536050.531000:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:1.0:1788536050.543297:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536050.543508:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589298432 00000100:00100000:2.0:1788536050.543519:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589298432 00000100:00100000:2.0:1788536050.543697:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:2.0:1788536050.543709:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+9:13745:x1875415589298432:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788536050.543726:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536050.543744:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b747e000/0x74f51638375d4d3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515a49 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536050.543772:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b747e000/0x74f51638375d4d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a49 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536050.543784:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b747e000/0x74f51638375d4d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a49 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536050.543793:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747e000, rc 0) 00000100:00100000:2.0:1788536050.543853:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+10:13745:x1875415589298432:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 147us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536050.543861:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:1.0:1788536050.549605:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536050.553361:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589298560 00000100:00100000:0.0:1788536050.553377:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589298560 00000100:00100000:0.0:1788536050.553437:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:0.0:1788536050.553448:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+10:13745:x1875415589298560:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788536050.554392:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+10:13745:x1875415589298560:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 940us (4790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536050.554403:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:1.0:1788536050.557552:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536050.557798:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589298688 00000100:00100000:2.0:1788536050.557808:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589298688 00000100:00100000:2.0:1788536050.557876:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:2.0:1788536050.557917:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+10:13745:x1875415589298688:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788536050.558689:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+10:13745:x1875415589298688:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 801us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536050.558698:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:1.0:1788536050.563105:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536050.563550:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589298816 00000100:00100000:0.0:1788536050.563560:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589298816 00000100:00100000:0.0:1788536050.563749:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:0.0:1788536050.563776:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+10:13769:x1875415589298816:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788536050.564083:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+10:13769:x1875415589298816:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 309us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536050.564092:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1788536050.568122:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536050.568311:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589298944 00000100:00100000:3.0:1788536050.568322:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589298944 00000100:00100000:3.0:1788536050.568378:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:3.0:1788536050.568387:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+10:13769:x1875415589298944:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788536050.568638:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+10:13769:x1875415589298944:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 250us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536050.568646:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1788536050.571501:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536050.571583:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589299072 00000100:00100000:3.0:1788536050.571592:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589299072 00000100:00100000:3.0:1788536050.571642:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788536050.571650:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2354:x1875415589299072:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788536050.571687:0:14321:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4ebbde98-87ac-49fa-9722-b860a25414cf@192.168.203.12@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:3.0:1788536050.571733:0:14321:0:(genops.c:1385:class_connect()) connect: client 4ebbde98-87ac-49fa-9722-b860a25414cf, cookie 0x74f51638375d4d44 00000004:00100000:3.0:1788536050.571766:0:14321:0:(mdt_handler.c:7337:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788536050.571785:0:14321:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788536050.616283:0:14321:0:(import.c:65:import_set_state_nolock()) ffff97a99c9c1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788536050.616371:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+6:2354:x1875415589299072:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 44718us (44876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536050.616383:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788536050.620036:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536050.620166:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536050.620627:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589299200 00000100:00100000:2.0:1788536050.620638:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589299200 00000100:00100000:3.0:1788536050.620717:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589299328 00000100:00100000:3.0:1788536050.620879:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589299328 00000100:00100000:3.0:1788536050.620959:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1788536050.620968:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+7:13745:x1875415589299328:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788536050.621068:0:14322:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788536050.621215:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+7:13745:x1875415589299328:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 247us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536050.621224:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788536050.621469:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788536050.621478:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+6:0:x1875415589299200:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788536050.621491:0:14320:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788536050.621530:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+6:0:x1875415589299200:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 53us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536050.621536:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788536050.623370:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00080000:0.0:1788536050.623393:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788536050.623454:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589299456 00000100:00100000:3.0:1788536050.623463:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589299456 00000100:00100000:3.0:1788536050.623511:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1788536050.623520:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+6:13745:x1875415589299456:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788536050.623600:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+6:13745:x1875415589299456:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 80us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536050.623607:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788536050.625208:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536050.625406:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589299840 00000100:00100000:0.0:1788536050.625417:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589299840 00000100:00100000:0.0:1788536050.625470:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788536050.625480:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+6:13745:x1875415589299840:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788536050.626666:0:14323:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1121us 00000100:00100000:3.0:1788536050.630172:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536050.630215:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536050.630994:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589299584 00000100:00100000:2.0:1788536050.631005:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589299584 00000100:00100000:2.0:1788536050.631056:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589299712 00000100:00100000:2.0:1788536050.631060:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589299712 00000100:00100000:2.0:1788536050.631075:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788536050.631083:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1875415589299584:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788536050.631113:0:15003:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4ebbde98-87ac-49fa-9722-b860a25414cf@192.168.203.12@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1788536050.631144:0:15003:0:(genops.c:1385:class_connect()) connect: client 4ebbde98-87ac-49fa-9722-b860a25414cf, cookie 0x74f51638375d4d4b 00002000:00100000:2.0:1788536050.631155:0:15003:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4ebbde98-87ac-49fa-9722-b860a25414cf/ffff97a991106000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788536050.631177:0:15003:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788536050.631489:0:15003:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788536050.631519:0:15003:0:(import.c:65:import_set_state_nolock()) ffff97a991101800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788536050.632878:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+6:2354:x1875415589299584:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 1631us (2551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536050.632904:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788536050.632934:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788536050.632940:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1875415589299712:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788536050.632965:0:15003:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4ebbde98-87ac-49fa-9722-b860a25414cf@192.168.203.12@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1788536050.632992:0:15003:0:(genops.c:1385:class_connect()) connect: client 4ebbde98-87ac-49fa-9722-b860a25414cf, cookie 0x74f51638375d4d52 00002000:00100000:2.0:1788536050.633002:0:15003:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4ebbde98-87ac-49fa-9722-b860a25414cf/ffff97a991104800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788536050.633022:0:15003:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788536050.633301:0:15003:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788536050.633330:0:15003:0:(import.c:65:import_set_state_nolock()) ffff97a991100800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788536050.633370:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+6:2354:x1875415589299712:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 429us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536050.633377:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000004:00200000:2.0:1788536050.643562:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788536050.643693:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+6:13745:x1875415589299840:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 18209us (18485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536050.643710:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788536050.890444:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536050.890590:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589299968 00000100:00100000:1.0:1788536050.890599:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589299968 00000100:00100000:1.0:1788536050.890657:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1788536050.890666:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+6:13790:x1875415589299968:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:1.0:1788536050.890696:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536050.890723:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d4d59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515a73 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536050.890787:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d4d60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536050.890800:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d4d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536050.890825:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d4d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788536050.890857:0:14321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788536050.890861:0:14321:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788536050.890941:0:14321:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d4d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536050.890966:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d4d59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a73 expref: 8 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536050.890984:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d4d60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a73 expref: 7 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536050.890993:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ada00) 00010000:00010000:1.0:1788536050.891008:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788536050.891012:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0ba00, rc 0) 00000100:00100000:1.0:1788536050.891074:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+7:13790:x1875415589299968:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 409us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536050.891082:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00010000:00010000:0.0:1788536050.957321:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536051.981098:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536051.981130:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607115904:0@lo:400:kworker.0 00000100:00100000:1.0:1788536051.981137:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607116032:0@lo:400:kworker.0 00000100:00100000:2.0:1788536051.981190:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607115648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788536051.981201:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536051.981202:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536051.981384:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607115904 00000100:00100000:3.0:1788536051.981392:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607115904 00000100:00100000:3.0:1788536051.981474:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788536051.981484:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607115904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536051.984231:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788536051.984253:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607116416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788536051.984316:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.985162:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607115776:0@lo:400:kworker.0 00000100:00100000:0.0:1788536051.985200:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.985222:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607116288:0@lo:400:kworker.0 00000100:00100000:0.0:1788536051.985241:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.985270:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607116032 00000100:00100000:0.0:1788536051.985277:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607116032 00000100:00100000:0.0:1788536051.985322:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607116288 00000100:00100000:0.0:1788536051.985324:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607116288 00000100:00100000:0.0:1788536051.985346:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788536051.985353:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607116032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536051.985401:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875415607116032:12345-0@lo:400:kworker.0 Request processed in 48us (4204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.985408:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788536051.985436:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788536051.985442:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607116288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536051.985469:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607116288:12345-0@lo:400:kworker.0 Request processed in 28us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.985475:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788536051.985507:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607116288:0@lo:400:kworker.0 00000100:00100000:0.0:1788536051.985537:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875415607116032:0@lo:400:kworker.0 00000100:00100000:0.0:1788536051.985633:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607116416 00000100:00100000:0.0:1788536051.985636:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607116416 00000100:00100000:1.0:1788536051.985735:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788536051.985744:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1788536051.985759:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788536051.985763:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788536051.985865:0:15003:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788536051.985946:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607115776 00000100:00100000:1.0:1788536051.985951:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607115776 00000100:00100000:2.0:1788536051.985952:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.985979:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607115648 00000100:00100000:1.0:1788536051.985980:0:15003:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788536051.985985:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49edad1-b206-4ca7-85f1-c4b27706521e:3310:1875415607115520:0@lo:400:kworker.0 00000100:00100000:0.0:1788536051.985985:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607115648 00000100:00100000:1.0:1788536051.985990:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788536051.986009:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788536051.986017:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875415607116416:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788536051.986024:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788536051.986045:0:15006:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788536051.986056:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607116160:0@lo:400:kworker.0 00000100:00100000:0.0:1788536051.986086:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875415607116416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.986093:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.986097:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788536051.986112:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788536051.986120:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b740ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875415607115648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788536051.986137:0:15006:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788536051.986160:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b740ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875415607115648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.986165:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788536051.986178:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788536051.986179:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607115776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536051.986205:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607116416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788536051.986209:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788536051.986227:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607115776:12345-0@lo:400:kworker.0 Request processed in 230us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.986229:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607115648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788536051.986235:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788536051.986238:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607115776:0@lo:400:kworker.0 00000100:00100000:2.0:1788536051.986258:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607115520 00000100:00100000:2.0:1788536051.986263:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607115520 00000100:00100000:0.0:1788536051.986283:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607116160 00000100:00100000:0.0:1788536051.986287:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607116160 00000100:00100000:2.0:1788536051.986292:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788536051.986300:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+19:3310:x1875415607115520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536051.986325:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788536051.986334:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607116160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536051.986342:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+19:3310:x1875415607115520:12345-0@lo:400:kworker.0 Request processed in 41us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.986349:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788536051.986350:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788536051.986370:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607116160:12345-0@lo:400:kworker.0 Request processed in 39us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.986377:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788536051.986386:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49edad1-b206-4ca7-85f1-c4b27706521e:3310:1875415607115520:0@lo:400:kworker.0 00000100:00100000:2.0:1788536051.986400:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607116160:0@lo:400:kworker.0 00000100:00100000:3.0:1788536051.987899:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607115904:12345-0@lo:400:kworker.0 Request processed in 6397us (6683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536051.987911:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788536051.988065:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607115904:0@lo:400:kworker.0 00000001:00100000:3.0:1788536052.560102:0:7609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4ebbde98-87ac-49fa-9722-b860a25414cf 00010000:00010000:0.0:1788536053.005365:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788536053.193054:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536053.193180:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589300096 00000100:00100000:2.0:1788536053.193193:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589300096 00000100:00100000:2.0:1788536053.193298:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788536053.193310:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+7:13842:x1875415589300096:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:2.0:1788536053.193370:0:14321:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788536053.193531:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+7:13842:x1875415589300096:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 221us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536053.193539:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:1.0:1788536053.194120:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788536053.202708:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536053.202830:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589300224 00000100:00100000:1.0:1788536053.202844:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589300224 00000100:00100000:1.0:1788536053.202990:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788536053.203033:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4ebbde98-87ac-49fa-9722-b860a25414cf+6:13842:x1875415589300224:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1788536053.203070:0:15006:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788536053.203192:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4ebbde98-87ac-49fa-9722-b860a25414cf+6:13842:x1875415589300224:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 171us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536053.203208:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00080000:0.0:1788536053.203666:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788536053.225101:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536053.225583:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589300352 00000100:00100000:1.0:1788536053.225598:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589300352 00000100:00100000:1.0:1788536053.225706:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788536053.225725:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4ebbde98-87ac-49fa-9722-b860a25414cf+5:13842:x1875415589300352:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1788536053.225761:0:15006:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788536053.225909:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4ebbde98-87ac-49fa-9722-b860a25414cf+5:13842:x1875415589300352:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 167us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536053.225927:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00080000:0.0:1788536053.226407:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788536053.478067:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536053.478207:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589300480 00000100:00100000:2.0:1788536053.478221:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589300480 00000100:00100000:2.0:1788536053.478298:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:2.0:1788536053.478309:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+10:13874:x1875415589300480:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788536053.478332:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536053.478355:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b747ec00/0x74f51638375d4d67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515a7a expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536053.478411:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b747ec00/0x74f51638375d4d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a7a expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536053.478424:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b747ec00/0x74f51638375d4d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a7a expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536053.478434:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747ec00, rc 0) 00000100:00100000:2.0:1788536053.479005:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+11:13874:x1875415589300480:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 693us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536053.479015:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:3.0:1788536053.511114:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536053.511430:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589300608 00000100:00100000:0.0:1788536053.511446:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589300608 00000100:00100000:0.0:1788536053.511604:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:0.0:1788536053.511619:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+11:13874:x1875415589300608:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788536053.514639:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+11:13874:x1875415589300608:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 3008us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536053.514667:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:3.0:1788536053.524372:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536053.524530:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589300736 00000100:00100000:0.0:1788536053.524544:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589300736 00000100:00100000:0.0:1788536053.525342:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:0.0:1788536053.525362:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+11:13874:x1875415589300736:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788536053.528565:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+11:13874:x1875415589300736:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 3191us (4189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536053.528588:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1788536053.540361:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536053.542383:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589300864 00000100:00100000:1.0:1788536053.542404:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589300864 00000100:00100000:1.0:1788536053.542494:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:1.0:1788536053.542507:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+11:13881:x1875415589300864:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788536053.546789:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+11:13881:x1875415589300864:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 4265us (6426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536053.546810:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:3.0:1788536053.571813:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536053.574377:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589300992 00000100:00100000:0.0:1788536053.574399:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589300992 00000100:00100000:0.0:1788536053.574526:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:0.0:1788536053.574540:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+11:13881:x1875415589300992:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788536053.578219:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+11:13881:x1875415589300992:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 3665us (6397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536053.578239:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:3.0:1788536053.585534:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536053.586275:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589301120 00000100:00100000:1.0:1788536053.586296:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589301120 00000100:00100000:1.0:1788536053.586408:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:1.0:1788536053.586421:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+11:13874:x1875415589301120:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788536053.586445:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536053.586469:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b6d0b400/0x74f51638375d4d6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515aa4 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536053.586510:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b6d0b400/0x74f51638375d4d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aa4 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536053.586523:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b6d0b400/0x74f51638375d4d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aa4 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536053.586534:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0b400, rc 0) 00000100:00100000:1.0:1788536053.587066:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+12:13874:x1875415589301120:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 645us (1539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536053.587074:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:3.0:1788536053.589847:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536053.591302:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589301248 00000100:00100000:2.0:1788536053.591335:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589301248 00000100:00100000:2.0:1788536053.591425:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:2.0:1788536053.591439:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+12:13874:x1875415589301248:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788536053.591472:0:14313:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788536053.591503:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788536053.591507:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788536053.591511:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788536053.591514:0:14313:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788536053.600061:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+12:13874:x1875415589301248:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 8606us (10203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536053.600079:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:3.0:1788536053.604648:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536053.606415:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589301376 00000100:00100000:1.0:1788536053.606441:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589301376 00000100:00100000:1.0:1788536053.606502:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:1.0:1788536053.606513:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+12:13874:x1875415589301376:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788536053.606530:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536053.606546:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b6d0a800/0x74f51638375d4d75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515aab expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536053.606575:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b6d0a800/0x74f51638375d4d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aab expref: 13 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536053.606586:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b6d0a800/0x74f51638375d4d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aab expref: 13 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536053.606610:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a800, rc 0) 00000100:00100000:1.0:1788536053.606685:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13874:x1875415589301376:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 174us (2046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536053.606693:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:0.0:1788536053.609676:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536053.610507:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589301504 00000100:00100000:3.0:1788536053.610518:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589301504 00000100:00100000:3.0:1788536053.610568:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:3.0:1788536053.610577:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13874:x1875415589301504:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788536053.610910:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13874:x1875415589301504:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 313us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536053.610920:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:0.0:1788536053.616020:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536053.616274:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589301632 00000100:00100000:3.0:1788536053.616302:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589301632 00000100:00100000:3.0:1788536053.616393:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:3.0:1788536053.616420:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13874:x1875415589301632:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788536053.622209:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13874:x1875415589301632:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 5780us (6186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536053.622226:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:0.0:1788536053.625854:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536053.626101:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589301760 00000100:00100000:1.0:1788536053.626112:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589301760 00000100:00100000:1.0:1788536053.626182:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1788536053.626192:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13887:x1875415589301760:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788536053.626567:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13887:x1875415589301760:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 374us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536053.626575:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:0.0:1788536053.630544:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536053.630756:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589301888 00000100:00100000:1.0:1788536053.630767:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589301888 00000100:00100000:1.0:1788536053.630824:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:1.0:1788536053.630833:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13887:x1875415589301888:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788536053.631146:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13887:x1875415589301888:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 313us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536053.631154:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:3.0:1788536053.643464:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536053.643554:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589302016 00000100:00100000:0.0:1788536053.643575:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589302016 00000100:00100000:0.0:1788536053.643628:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788536053.643637:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2354:x1875415589302016:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788536053.643677:0:14320:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 801f3f5f-e678-4c00-91a4-f7506520d14a@192.168.203.12@tcp t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:0.0:1788536053.643719:0:14320:0:(genops.c:1385:class_connect()) connect: client 801f3f5f-e678-4c00-91a4-f7506520d14a, cookie 0x74f51638375d4d7c 00000004:00100000:0.0:1788536053.643752:0:14320:0:(mdt_handler.c:7337:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788536053.643876:0:14320:0:(import.c:65:import_set_state_nolock()) ffff97a989327800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788536053.643981:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+6:2354:x1875415589302016:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 344us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536053.643989:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788536053.649272:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536053.649323:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536053.649444:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589302272 00000100:00100000:1.0:1788536053.649454:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589302272 00000100:00100000:1.0:1788536053.649514:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589302144 00000100:00100000:1.0:1788536053.649522:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589302144 00000100:00100000:1.0:1788536053.649541:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788536053.649549:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b740b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+7:13874:x1875415589302272:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788536053.649587:0:14321:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788536053.649642:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b740b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+7:13874:x1875415589302272:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 94us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536053.649649:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788536053.649678:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788536053.649684:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+6:0:x1875415589302144:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788536053.649694:0:14321:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788536053.649711:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+6:0:x1875415589302144:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 28us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536053.649717:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00080000:0.0:1788536053.649829:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788536053.651785:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536053.651867:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589302400 00000100:00100000:2.0:1788536053.651876:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589302400 00000100:00100000:2.0:1788536053.651949:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788536053.651959:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+6:13874:x1875415589302400:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788536053.652033:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+6:13874:x1875415589302400:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 76us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536053.652040:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1788536053.668347:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536053.669054:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589302784 00000100:00100000:2.0:1788536053.669066:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589302784 00000100:00100000:2.0:1788536053.669126:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:2.0:1788536053.669135:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+6:13874:x1875415589302784:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788536053.669202:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788536053.669286:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+6:13874:x1875415589302784:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 152us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536053.669294:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1788536053.674500:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536053.674572:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536053.675244:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589302528 00000100:00100000:0.0:1788536053.675254:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589302528 00000100:00100000:0.0:1788536053.675285:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589302656 00000100:00100000:0.0:1788536053.675288:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589302656 00000100:00100000:0.0:1788536053.675311:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788536053.675415:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875415589302528:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788536053.675448:0:15004:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 801f3f5f-e678-4c00-91a4-f7506520d14a@192.168.203.12@tcp t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:0.0:1788536053.675488:0:15004:0:(genops.c:1385:class_connect()) connect: client 801f3f5f-e678-4c00-91a4-f7506520d14a, cookie 0x74f51638375d4d83 00002000:00100000:0.0:1788536053.675507:0:15004:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 801f3f5f-e678-4c00-91a4-f7506520d14a/ffff97a989322800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788536053.675517:0:15004:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788536053.675713:0:15004:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788536053.675748:0:15004:0:(import.c:65:import_set_state_nolock()) ffff97a989323800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788536053.675808:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+6:2354:x1875415589302528:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 488us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536053.675816:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788536053.675836:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788536053.675840:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875415589302656:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788536053.675854:0:15004:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 801f3f5f-e678-4c00-91a4-f7506520d14a@192.168.203.12@tcp t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:0.0:1788536053.675871:0:15004:0:(genops.c:1385:class_connect()) connect: client 801f3f5f-e678-4c00-91a4-f7506520d14a, cookie 0x74f51638375d4d8a 00002000:00100000:0.0:1788536053.675876:0:15004:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 801f3f5f-e678-4c00-91a4-f7506520d14a/ffff97a989320800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788536053.675882:0:15004:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788536053.678052:0:15004:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788536053.678091:0:15004:0:(import.c:65:import_set_state_nolock()) ffff97a990fca800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788536053.678745:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+6:2354:x1875415589302656:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 2899us (4169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536053.678757:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788536053.899637:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536053.899862:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589302912 00000100:00100000:3.0:1788536053.899872:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589302912 00000100:00100000:3.0:1788536053.899981:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788536053.899992:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+6:13908:x1875415589302912:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:3.0:1788536053.900013:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536053.900035:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030200/0x74f51638375d4d91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515ad5 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.900094:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d4d98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.900110:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d4d98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.900136:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d4d98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788536053.900169:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788536053.900173:0:14322:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788536053.900190:0:14322:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d4d98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.900211:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980030200/0x74f51638375d4d91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ad5 expref: 8 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.900229:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d4d98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ad5 expref: 7 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.900237:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ada00) 00010000:00010000:3.0:1788536053.900252:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788536053.900256:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a980031000, rc 0) 00000100:00100000:3.0:1788536053.900320:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+7:13908:x1875415589302912:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 329us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536053.900327:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00010000:00010000:0.0:1788536054.031800:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788536054.091275:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 801f3f5f-e678-4c00-91a4-f7506520d14a 00000001:00100000:2.0:1788536054.091290:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4ebbde98-87ac-49fa-9722-b860a25414cf 00010000:00010000:2.0:1788536055.053792:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536056.077092:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788536056.136292:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 801f3f5f-e678-4c00-91a4-f7506520d14a 00000001:00100000:1.0:1788536056.136309:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4ebbde98-87ac-49fa-9722-b860a25414cf 00000100:00100000:1.0:1788536057.102345:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607116544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788536057.102415:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536057.103336:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607116672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788536057.103383:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536057.103440:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607116544 00000100:00100000:3.0:1788536057.103449:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607116544 00000100:00100000:3.0:1788536057.103519:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607116672 00000100:00100000:3.0:1788536057.103522:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607116672 00000100:00100000:3.0:1788536057.103541:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788536057.103549:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607116544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788536057.103583:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788536057.103621:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607116544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536057.103639:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788536057.103655:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788536057.103662:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607116672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788536057.103680:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788536057.103711:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875415607116672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536057.103717:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788536057.103734:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788536057.103738:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788536057.104043:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607116544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788536057.104565:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875415607116672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788536057.104764:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607116928:0@lo:400:kworker.0 00000100:00100000:0.0:1788536057.104807:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536057.104829:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788536057.104834:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607117056:0@lo:400:kworker.0 00000100:00100000:0.0:1788536057.104871:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536057.104910:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607116928 00000100:00100000:0.0:1788536057.104915:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607116928 00000100:00100000:0.0:1788536057.104944:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607117056 00000100:00100000:0.0:1788536057.104946:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607117056 00000100:00100000:0.0:1788536057.104966:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788536057.104973:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607116928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536057.105012:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607116928:12345-0@lo:400:kworker.0 Request processed in 40us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536057.105019:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788536057.105030:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788536057.105036:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607117056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536057.105059:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607117056:12345-0@lo:400:kworker.0 Request processed in 24us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536057.105065:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788536057.105089:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607117056:0@lo:400:kworker.0 00000100:00100000:0.0:1788536057.105097:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607116928:0@lo:400:kworker.0 00010000:00010000:0.0:1788536057.105139:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788536057.109061:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49edad1-b206-4ca7-85f1-c4b27706521e:3311:1875415607116800:0@lo:400:kworker.0 00000100:00100000:3.0:1788536057.109162:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536057.109222:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788536057.109229:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607117184:0@lo:400:kworker.0 00000100:00100000:3.0:1788536057.109255:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788536057.109294:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788536057.109353:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607117184 00000100:00100000:1.0:1788536057.109363:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607117184 00000100:00100000:1.0:1788536057.109432:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788536057.109441:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607117184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536057.109509:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607117184:12345-0@lo:400:kworker.0 Request processed in 68us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536057.109526:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788536057.109636:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788536057.109668:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607117184:0@lo:400:kworker.0 00000100:00100000:0.0:1788536057.110251:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607116800 00000100:00100000:0.0:1788536057.110260:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607116800 00000100:00100000:0.0:1788536057.110306:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788536057.110316:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+19:3311:x1875415607116800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536057.110376:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+19:3311:x1875415607116800:12345-0@lo:400:kworker.0 Request processed in 62us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536057.110382:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788536057.110478:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49edad1-b206-4ca7-85f1-c4b27706521e:3311:1875415607116800:0@lo:400:kworker.0 00000001:02000400:1.0:1788536057.439233:0:16276:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788536057.670769:0:7609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 801f3f5f-e678-4c00-91a4-f7506520d14a 00010000:00010000:0.0:1788536058.125169:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788536058.382979:0:14353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788536058.764336:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536058.764374:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536058.764398:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536058.764417:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536058.764433:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536058.764449:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536058.764470:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536058.764495:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589303168 00000100:00100000:1.0:1788536058.764503:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589303168 00000100:00100000:0.0:1788536058.764647:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589303040 00000100:00100000:0.0:1788536058.764652:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589303040 00000100:00100000:0.0:1788536058.764687:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:0.0:1788536058.764698:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b734d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:2356:x1875415589303040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788536058.764775:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b734d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:2356:x1875415589303040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 79us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536058.764783:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:0.0:1788536058.765000:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589303552 00000100:00100000:0.0:1788536058.765005:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589303552 00000100:00100000:0.0:1788536058.765034:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788536058.765041:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+6:2357:x1875415589303168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788536058.765078:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+6:2357:x1875415589303168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 37us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536058.765155:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788536058.765173:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788536058.765181:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+6:2357:x1875415589303552:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788536058.765208:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+6:2357:x1875415589303552:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536058.765214:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788536058.765232:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589303424 00000100:00100000:0.0:1788536058.765236:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589303424 00000100:00100000:0.0:1788536058.765255:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589303680 00000100:00100000:0.0:1788536058.765260:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589303680 00000100:00100000:0.0:1788536058.765273:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589303296 00000100:00100000:0.0:1788536058.765276:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589303296 00000100:00100000:0.0:1788536058.765286:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589303808 00000100:00100000:0.0:1788536058.765288:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589303808 00000100:00100000:0.0:1788536058.765318:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:0.0:1788536058.765324:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+5:2357:x1875415589303424:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788536058.765349:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+5:2357:x1875415589303424:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536058.765354:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:0.0:1788536058.765365:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1788536058.765370:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+5:2357:x1875415589303680:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788536058.765389:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+5:2357:x1875415589303680:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 19us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536058.765394:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1788536058.765405:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1788536058.765411:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+5:2357:x1875415589303296:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788536058.765430:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+5:2357:x1875415589303296:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536058.765435:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1788536058.765444:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1788536058.765450:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+5:2357:x1875415589303808:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788536058.765471:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+5:2357:x1875415589303808:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536058.765477:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00080000:1.0:1788536058.765571:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788536058.765576:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788536058.765578:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788536059.157448:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536060.173321:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536061.197079:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788536061.735431:0:16427:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa73d8c50 20000000:00000080:3.0:1788536061.735449:0:16427:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a882328000 uarg=0000000000000000 20000000:01000000:3.0:1788536061.735485:0:16427:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788536061.735491:0:16427:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788536061.735496:0:16427:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788536061.736915:0:16428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788536061.737080:0:16427:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788536061.745398:0:16427:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788536061.745429:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.745448:0:16427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a987ecb200/0x74f51638375d4a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4a8f expref: 18 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.745455:0:16427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9bfc51200/0x74f51638375d4ae3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4adc expref: 18 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.745462:0:16427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9bfc50600/0x74f51638375d4b53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4b4c expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.745472:0:16427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9b747e000/0x74f51638375d4d3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a49 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.745497:0:16427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a9b6d0a800/0x74f51638375d4d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aab expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.745505:0:16427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.745545:0:16427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9b6d0a800/0x74f51638375d4d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aab expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.745559:0:16427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a9b6d0a800/0x74f51638375d4d75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aab expref: 12 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536061.745573:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1875415607117312:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788536061.745782:0:16427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9b747e000/0x74f51638375d4d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a49 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.745792:0:16427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a9b747e000/0x74f51638375d4d3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a49 expref: 12 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536061.745801:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1875415607117440:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788536061.745831:0:16427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9bfc50600/0x74f51638375d4b53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d4b4c expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.745839:0:16427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a9bfc50600/0x74f51638375d4b53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d4b4c expref: 18 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536061.745848:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1875415607117568:0@lo:104: 00000100:00100000:1.0:1788536061.745925:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788536061.745976:0:16427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a9bfc51200/0x74f51638375d4ae3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d4adc expref: 18 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.745985:0:16427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a9bfc51200/0x74f51638375d4ae3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d4adc expref: 18 pid: 14314 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536061.745993:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1875415607117696:0@lo:104: 00000100:00100000:1.0:1788536061.746015:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788536061.746036:0:16427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a987ecb200/0x74f51638375d4a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74f51638375d4a8f expref: 18 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.746044:0:16427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a987ecb200/0x74f51638375d4a96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74f51638375d4a8f expref: 18 pid: 14313 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536061.746052:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1875415607117824:0@lo:104: 00000100:00100000:1.0:1788536061.746086:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536061.746096:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67fe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788536061.746271:0:14303:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788536061.746284:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607117568 00000100:00100000:2.0:1788536061.746291:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607117568 00000100:00100000:2.0:1788536061.746337:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607117696 00000100:00100000:2.0:1788536061.746341:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607117696 00000100:00100000:2.0:1788536061.746350:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607117824 00000100:00100000:2.0:1788536061.746352:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607117824 00000100:00100000:2.0:1788536061.746376:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788536061.746385:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+5:16427:x1875415607117568:12345-0@lo:104: 00010000:00010000:2.0:1788536061.746398:0:14303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4b53 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746457:0:14303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788536061.746463:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+5:16427:x1875415607117568:12345-0@lo:104: Request processed in 80us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536061.746470:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788536061.746486:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788536061.746492:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+4:16427:x1875415607117696:12345-0@lo:104: 00010000:00010000:2.0:1788536061.746499:0:14303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4ae3 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746530:0:14303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788536061.746535:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+4:16427:x1875415607117696:12345-0@lo:104: Request processed in 44us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536061.746541:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788536061.746553:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788536061.746558:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+3:16427:x1875415607117824:12345-0@lo:104: 00010000:00010000:2.0:1788536061.746564:0:14303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4a96 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746589:0:14303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788536061.746593:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+3:16427:x1875415607117824:12345-0@lo:104: Request processed in 36us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536061.746610:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788536061.746651:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788536061.746662:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4b53 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746669:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b200 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:2.0:1788536061.746672:0:14309:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d4b53 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746681:0:14309:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d4b53 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788536061.746687:0:14309:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d4b53 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536061.746692:0:14309:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788536061.746734:0:14309:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4b53 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746741:0:14309:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788536061.746760:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4b53 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746767:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b200/0x74f51638375d4b4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4b53 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746779:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788536061.746782:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4ae3 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746788:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b800 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:2.0:1788536061.746790:0:14309:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d4ae3 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746807:0:14309:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d4ae3 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788536061.746813:0:14309:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d4ae3 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536061.746819:0:14309:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788536061.746832:0:14309:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4ae3 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746837:0:14309:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788536061.746852:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4ae3 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746859:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0b800/0x74f51638375d4adc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4ae3 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746868:0:14309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536061.746871:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74f51638375d4a96 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746876:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0be00 already unused, calling callback (ffffffffc1a72c20) 10000000:00010000:2.0:1788536061.746879:0:14309:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74f51638375d4a96 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746885:0:14309:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74f51638375d4a96 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788536061.746915:0:14309:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74f51638375d4a96 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536061.746927:0:14309:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788536061.746940:0:14309:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4a96 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746946:0:14309:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788536061.746951:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4a96 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746958:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff97a9b6d0be00/0x74f51638375d4a8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74f51638375d4a96 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.746971:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536061.746972:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536061.746974:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536061.746981:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536061.746999:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49edad1-b206-4ca7-85f1-c4b27706521e:3311:1875415607117952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788536061.747029:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536061.747065:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49edad1-b206-4ca7-85f1-c4b27706521e:3308:1875415607118080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788536061.747087:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536061.747105:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788536061.747838:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49edad1-b206-4ca7-85f1-c4b27706521e:3308:1875415607118208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788536061.747875:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536061.747956:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607117952 00000100:00100000:2.0:1788536061.747962:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607117952 00010000:00010000:2.0:1788536061.747989:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9bfc50600/0x74f51638375d4b53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4b4c expref: 19 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536061.748008:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607118080 00000100:00100000:2.0:1788536061.748019:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607118080 00010000:00010000:2.0:1788536061.748033:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9bfc51200/0x74f51638375d4ae3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4adc expref: 20 pid: 14314 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536061.748045:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607118208 00000100:00100000:2.0:1788536061.748047:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607118208 00010000:00010000:2.0:1788536061.748070:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a987ecb200/0x74f51638375d4a96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4a8f expref: 21 pid: 14313 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536061.748083:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788536061.748091:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49edad1-b206-4ca7-85f1-c4b27706521e+21:3311:x1875415607117952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788536061.748103:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788536061.748829:0:14307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9bfc50600/0x74f51638375d4b53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4b4c expref: 21 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.748851:0:14307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9bfc50600/0x74f51638375d4b53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d4b4c expref: 21 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.748878:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788536061.748963:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49edad1-b206-4ca7-85f1-c4b27706521e+21:3311:x1875415607117952:12345-0@lo:103:ldlm_bl.0 Request processed in 873us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536061.748972:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788536061.749001:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788536061.749008:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49edad1-b206-4ca7-85f1-c4b27706521e+20:3308:x1875415607118080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788536061.749019:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788536061.749024:0:14307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9bfc51200/0x74f51638375d4ae3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4adc expref: 20 pid: 14314 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.749032:0:14307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9bfc51200/0x74f51638375d4ae3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d4adc expref: 20 pid: 14314 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536061.749057:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788536061.749097:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c49edad1-b206-4ca7-85f1-c4b27706521e+20:3308:x1875415607118080:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536061.749103:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788536061.749261:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788536061.749280:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7053850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+20:3308:x1875415607118208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788536061.749288:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788536061.749294:0:14305:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a987ecb200/0x74f51638375d4a96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74f51638375d4a8f expref: 20 pid: 14313 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536061.749314:0:14305:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a987ecb200/0x74f51638375d4a96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74f51638375d4a8f expref: 20 pid: 14313 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536061.749323:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788536061.749348:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7053850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c49edad1-b206-4ca7-85f1-c4b27706521e+20:3308:x1875415607118208:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536061.749354:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788536061.749591:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9bfc50600/0x74f51638375d4b53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d4b4c expref: 19 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536061.749616:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1875415607117568:0@lo:104: 00010000:00010000:1.0:1788536061.749630:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9bfc51200/0x74f51638375d4ae3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d4adc expref: 18 pid: 14314 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536061.749638:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1875415607117696:0@lo:104: 00010000:00010000:1.0:1788536061.749649:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a987ecb200/0x74f51638375d4a96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74f51638375d4a8f expref: 17 pid: 14313 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536061.749656:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1875415607117824:0@lo:104: 00000100:00100000:2.0:1788536061.749878:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49edad1-b206-4ca7-85f1-c4b27706521e:3311:1875415607117952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788536061.749936:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49edad1-b206-4ca7-85f1-c4b27706521e:3308:1875415607118208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788536061.749945:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c49edad1-b206-4ca7-85f1-c4b27706521e:3308:1875415607118080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788536061.758230:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536061.758282:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536061.758415:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589303936 00000100:00100000:3.0:1788536061.758425:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589303936 00010000:00010000:3.0:1788536061.758462:0:14305:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9b6d0a800/0x74f51638375d4d75 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aab expref: 13 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536061.758498:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589304064 00000100:00100000:3.0:1788536061.758502:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589304064 00010000:00010000:3.0:1788536061.758514:0:14305:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a9b747e000/0x74f51638375d4d3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a49 expref: 14 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536061.758529:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1788536061.758537:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+14:2355:x1875415589303936:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788536061.758560:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536061.758577:0:14305:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9b6d0a800/0x74f51638375d4d75 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aab expref: 14 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536061.758616:0:14305:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9b6d0a800/0x74f51638375d4d75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aab expref: 14 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536061.758636:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536061.758693:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+14:2355:x1875415589303936:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 155us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536061.758701:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1788536061.758839:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788536061.758847:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:2356:x1875415589304064:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788536061.758857:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536061.758862:0:14305:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a9b747e000/0x74f51638375d4d3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a49 expref: 13 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536061.758872:0:14305:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a9b747e000/0x74f51638375d4d3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a49 expref: 13 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536061.758912:0:14305:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536061.758921:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536061.758936:0:14305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536061.758943:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536061.758960:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536061.758967:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536061.758973:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a600 already unused, calling callback (ffffffffc1455530) 00010000:00010000:3.0:1788536061.758977:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536061.758985:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536061.758993:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536061.759005:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536061.759023:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:2356:x1875415589304064:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 178us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536061.759030:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00010000:00010000:1.0:1788536061.759592:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9b6d0a800/0x74f51638375d4d75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aab expref: 12 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536061.759625:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1875415607117312:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788536061.759641:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9b747e000/0x74f51638375d4d3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a49 expref: 11 pid: 14315 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536061.759649:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1875415607117440:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788536061.759681:0:16427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.759689:0:16427:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.759695:0:16427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536061.759700:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a9b6d0a600/0x74f51638375d4d9f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536062.221555:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788536062.221576:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607118336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788536062.221650:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536062.221715:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607118336 00000100:00100000:0.0:1788536062.221723:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607118336 00000100:00100000:0.0:1788536062.221773:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788536062.221786:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607118336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788536062.221821:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788536062.221865:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607118336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536062.221873:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788536062.221913:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788536062.221950:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607118336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788536062.222246:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607118592:0@lo:400:kworker.0 00000100:00100000:3.0:1788536062.222277:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536062.222306:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788536062.222312:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607118720:0@lo:400:kworker.0 00000100:00100000:3.0:1788536062.222336:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536062.222547:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607118848:0@lo:400:kworker.0 00000100:00100000:1.0:1788536062.222575:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536062.222612:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788536062.222618:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49edad1-b206-4ca7-85f1-c4b27706521e:3310:1875415607118464:0@lo:400:kworker.0 00000100:00100000:1.0:1788536062.222645:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536062.222668:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607118976:0@lo:400:kworker.0 00000100:00100000:1.0:1788536062.222688:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536062.222715:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607118464 00000100:00100000:1.0:1788536062.222719:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607118464 00000100:00100000:1.0:1788536062.222759:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788536062.222766:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+16:3310:x1875415607118464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536062.222804:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+16:3310:x1875415607118464:12345-0@lo:400:kworker.0 Request processed in 38us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536062.222810:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788536062.222838:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607118720 00000100:00100000:1.0:1788536062.222842:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607118720 00000100:00100000:1.0:1788536062.222864:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607118848 00000100:00100000:1.0:1788536062.222867:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607118848 00000100:00100000:1.0:1788536062.222883:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607118976 00000100:00100000:1.0:1788536062.222906:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607118976 00000100:00100000:1.0:1788536062.222924:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788536062.222930:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607118720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536062.222966:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607118720:12345-0@lo:400:kworker.0 Request processed in 36us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536062.222973:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788536062.222998:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788536062.223004:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607118848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536062.223032:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875415607118848:12345-0@lo:400:kworker.0 Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536062.223038:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788536062.223213:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788536062.223220:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607118976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536062.223251:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875415607118976:12345-0@lo:400:kworker.0 Request processed in 32us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536062.223257:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788536062.223418:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607118592 00000100:00100000:0.0:1788536062.223428:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607118592 00000100:00100000:0.0:1788536062.223458:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788536062.223465:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607118592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536062.223496:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607118592:12345-0@lo:400:kworker.0 Request processed in 33us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536062.223503:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788536062.223528:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788536062.223532:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788536062.223539:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788536062.223548:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607119104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788536062.223574:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536062.223614:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607119104 00000100:00100000:0.0:1788536062.223618:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607119104 00000100:00100000:0.0:1788536062.223641:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788536062.223648:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607119104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788536062.223670:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788536062.223703:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607119104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536062.223709:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788536062.223741:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607119104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788536062.223784:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49edad1-b206-4ca7-85f1-c4b27706521e:3310:1875415607118464:0@lo:400:kworker.0 00000100:00100000:0.0:1788536062.223794:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875415607118976:0@lo:400:kworker.0 00000100:00100000:0.0:1788536062.223803:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875415607118848:0@lo:400:kworker.0 00000100:00100000:1.0:1788536062.223857:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607118720:0@lo:400:kworker.0 00000100:00100000:1.0:1788536062.223877:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607118592:0@lo:400:kworker.0 00010000:00010000:2.0:1788536062.225033:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536062.966657:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536062.966925:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589304192 00000100:00100000:0.0:1788536062.966934:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589304192 00000100:00100000:0.0:1788536062.967010:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:0.0:1788536062.967030:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+11:13759:x1875415589304192:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788536062.967050:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536062.967073:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a98ab4ba00/0x74f51638375d4da6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515adc expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536062.968961:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4ba00/0x74f51638375d4da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515adc expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536062.968984:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a98ab4ba00/0x74f51638375d4da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515adc expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536062.968995:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4ba00, rc 0) 00000100:00100000:0.0:1788536062.969066:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+12:13759:x1875415589304192:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 2038us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536062.969075:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:3.0:1788536062.978806:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536062.978922:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589304320 00000100:00100000:0.0:1788536062.978934:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589304320 00000100:00100000:0.0:1788536062.978991:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:0.0:1788536062.979002:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+12:13759:x1875415589304320:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788536062.979298:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+12:13759:x1875415589304320:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 289us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536062.979306:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:0.0:1788536062.984692:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536062.986226:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589304448 00000100:00100000:2.0:1788536062.986240:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589304448 00000100:00100000:2.0:1788536062.986310:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:2.0:1788536062.986321:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+12:13759:x1875415589304448:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788536062.986557:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+12:13759:x1875415589304448:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 236us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536062.986566:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:3.0:1788536063.003711:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536063.003939:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589304576 00000100:00100000:0.0:1788536063.003949:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589304576 00000100:00100000:0.0:1788536063.004001:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:0.0:1788536063.004011:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+12:13759:x1875415589304576:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788536063.004040:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536063.004071:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a98ab4b200/0x74f51638375d4dad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515ae3 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536063.004109:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a98ab4b200/0x74f51638375d4dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ae3 expref: 13 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536063.004120:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a98ab4b200/0x74f51638375d4dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ae3 expref: 13 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536063.004129:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b200, rc 0) 00000100:00100000:0.0:1788536063.004176:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13759:x1875415589304576:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 167us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536063.004183:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:2.0:1788536063.018419:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536063.020955:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589304704 00000100:00100000:1.0:1788536063.020969:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589304704 00000100:00100000:1.0:1788536063.021018:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:1.0:1788536063.021028:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13759:x1875415589304704:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788536063.027177:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13759:x1875415589304704:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 6140us (8758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536063.027193:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:1.0:1788536063.046738:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536063.050218:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589304832 00000100:00100000:0.0:1788536063.050233:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589304832 00000100:00100000:0.0:1788536063.050302:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:0.0:1788536063.050314:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba22c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13759:x1875415589304832:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788536063.051169:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba22c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:13759:x1875415589304832:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 851us (4435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536063.051179:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 110 10000000:01000000:2.0:1788536063.244976:0:14317:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788536063.244984:0:14317:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a9ac46b000 from 10 10000000:01000000:2.0:1788536063.244990:0:14317:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788536063.245043:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d4db4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536063.245055:0:14317:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d4db4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536063.245095:0:14317:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d4db4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536063.245124:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607119232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788536063.245193:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536063.245243:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9a06540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788536063.245529:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607119232 00000100:00100000:1.0:1788536063.245537:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607119232 00000100:00100000:1.0:1788536063.245595:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788536063.245605:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+16:14317:x1875415607119232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536063.245617:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536063.245630:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4dbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4db4 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536063.245652:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4dbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4db4 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536063.245662:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b6d0a400/0x74f51638375d4dbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4db4 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536063.245671:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a400, rc 0) 00000100:00100000:1.0:1788536063.245710:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+17:14317:x1875415607119232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536063.245717:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788536063.245773:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607119232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536063.245787:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d4db4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4dbb expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536063.245796:0:14317:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d4db4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4dbb expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536063.245852:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607119360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788536063.245877:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536063.245914:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b67feb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788536063.245927:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607119360 00000100:00100000:1.0:1788536063.245931:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607119360 00000100:00100000:1.0:1788536063.245950:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788536063.245956:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+17:14317:x1875415607119360:12345-0@lo:501:ll_cfg_requeue.0 00010000:00010000:2.0:1788536063.246203:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788536063.246516:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+17:14317:x1875415607119360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 559us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536063.246525:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788536063.246980:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607119360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788536063.247018:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607119488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788536063.247065:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536063.247103:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9a06540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788536063.247279:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607119488 00000100:00100000:1.0:1788536063.248146:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607119488 00000100:00100000:1.0:1788536063.248201:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788536063.248210:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+17:14317:x1875415607119488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788536063.251187:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+17:14317:x1875415607119488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2970us (4113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536063.251201:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788536063.253269:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607119488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788536063.258718:0:16481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788536063.258978:0:14317:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788536063.259002:0:14317:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788536063.259015:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d4db4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4dbb expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536063.259027:0:14317:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b747f600/0x74f51638375d4db4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4dbb expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536063.259037:0:14317:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788536063.259040:0:14317:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a98601c800 from 10 10000000:01000000:2.0:1788536063.259042:0:14317:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788536063.259090:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d4dc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536063.259099:0:14317:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d4dc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536063.259123:0:14317:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d4dc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536063.259149:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607119616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788536063.259217:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536063.259251:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a99855fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788536063.259323:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607119616 00000100:00100000:1.0:1788536063.259331:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607119616 00000100:00100000:1.0:1788536063.259377:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788536063.259402:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+17:14317:x1875415607119616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536063.259416:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536063.259428:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b6d0ac00/0x74f51638375d4dc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4dc2 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536063.259451:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b6d0ac00/0x74f51638375d4dc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4dc2 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536063.259462:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b6d0ac00/0x74f51638375d4dc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4dc2 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536063.259470:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0ac00, rc 0) 00000100:00100000:1.0:1788536063.259515:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+18:14317:x1875415607119616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536063.259522:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788536063.264881:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607119616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788536063.264928:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d4dc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4dc9 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536063.264942:0:14317:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d4dc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4dc9 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536063.265040:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607119744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788536063.265100:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536063.265141:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788536063.265696:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607119744 00000100:00100000:2.0:1788536063.265705:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607119744 00000100:00100000:2.0:1788536063.265764:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788536063.265773:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+18:14317:x1875415607119744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788536063.266085:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+18:14317:x1875415607119744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536063.266093:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788536063.275011:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607119744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788536063.275082:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607119872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788536063.275152:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536063.275189:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788536063.275255:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607119872 00000100:00100000:2.0:1788536063.275262:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607119872 00000100:00100000:2.0:1788536063.275321:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788536063.275331:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+18:14317:x1875415607119872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788536063.275525:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+18:14317:x1875415607119872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536063.275532:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788536063.277690:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607119872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788536063.287736:0:16483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788536063.287967:0:14317:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788536063.287988:0:14317:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788536063.287998:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d4dc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4dc9 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536063.288009:0:14317:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a9b747e400/0x74f51638375d4dc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4dc9 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536063.288021:0:14317:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788536063.288023:0:14317:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a988040000 from 10 10000000:01000000:0.0:1788536063.288026:0:14317:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788536063.288063:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b400/0x74f51638375d4dd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536063.288081:0:14317:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b400/0x74f51638375d4dd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536063.288091:0:14317:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b400/0x74f51638375d4dd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536063.288126:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607120000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788536063.288189:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536063.288223:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788536063.289359:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607120000 00000100:00100000:2.0:1788536063.289370:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607120000 00000100:00100000:2.0:1788536063.289431:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788536063.289441:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+18:14317:x1875415607120000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788536063.289467:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536063.289483:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a9b747f400/0x74f51638375d4dd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74f51638375d4dd0 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536063.289507:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a9b747f400/0x74f51638375d4dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74f51638375d4dd0 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536063.289518:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a9b747f400/0x74f51638375d4dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74f51638375d4dd0 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536063.289526:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747f400, rc 0) 00000100:00100000:2.0:1788536063.289596:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+19:14317:x1875415607120000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536063.289603:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788536063.289866:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607120000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788536063.289915:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b400/0x74f51638375d4dd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4dd7 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536063.289926:0:14317:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b400/0x74f51638375d4dd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74f51638375d4dd7 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536063.289988:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607120128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788536063.290021:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536063.290053:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b8d6b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788536063.291523:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607120128 00000100:00100000:2.0:1788536063.291537:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607120128 00000100:00100000:2.0:1788536063.291606:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788536063.291617:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+19:14317:x1875415607120128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788536063.291998:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c49edad1-b206-4ca7-85f1-c4b27706521e+19:14317:x1875415607120128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 382us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536063.292006:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788536063.292528:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607120128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788536063.292581:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607120256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788536063.292644:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536063.292686:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9b7d65480 going to sleep for 11 seconds 00000100:00100000:3.0:1788536063.292734:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607120256 00000100:00100000:3.0:1788536063.292739:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607120256 00000100:00100000:3.0:1788536063.292777:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788536063.292786:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+19:14317:x1875415607120256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788536063.292975:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c49edad1-b206-4ca7-85f1-c4b27706521e+19:14317:x1875415607120256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536063.292981:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788536063.296296:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c49edad1-b206-4ca7-85f1-c4b27706521e:14317:1875415607120256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788536063.305998:0:16484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788536063.306338:0:14317:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788536063.306361:0:14317:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788536063.306372:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b400/0x74f51638375d4dd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4dd7 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536063.306394:0:14317:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff97a98ab4b400/0x74f51638375d4dd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74f51638375d4dd7 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536063.859110:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536063.859161:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536063.859187:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536063.859272:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589304960 00000100:00100000:1.0:1788536063.859283:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589304960 00000100:00100000:3.0:1788536063.866801:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536063.875649:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536063.875699:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536063.875725:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589305344 00000100:00100000:1.0:1788536063.875734:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589305344 00000100:00100000:1.0:1788536063.875764:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1788536063.875773:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+6:2357:x1875415589304960:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788536063.875988:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+6:2357:x1875415589304960:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 215us (16825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536063.875997:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1788536063.876013:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1788536063.876020:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:801f3f5f-e678-4c00-91a4-f7506520d14a+6:2358:x1875415589305344:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788536063.876044:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:801f3f5f-e678-4c00-91a4-f7506520d14a+6:2358:x1875415589305344:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536063.876050:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1788536063.877304:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589305088 00000100:00100000:2.0:1788536063.877316:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589305088 00000100:00100000:2.0:1788536063.877379:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589305216 00000100:00100000:2.0:1788536063.877382:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589305216 00000100:00100000:2.0:1788536063.877395:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589305472 00000100:00100000:2.0:1788536063.877397:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589305472 00000100:00100000:2.0:1788536063.877422:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788536063.877446:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+5:2358:x1875415589305088:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788536063.877506:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+5:2358:x1875415589305088:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 62us (18405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536063.877513:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788536063.877531:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788536063.877537:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+5:2357:x1875415589305216:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788536063.877556:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+5:2357:x1875415589305216:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (18369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536063.877562:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788536063.877572:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788536063.877577:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+5:2357:x1875415589305472:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788536063.877611:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+5:2357:x1875415589305472:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (10821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536063.877617:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00080000:0.0:1788536063.881089:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788536063.881098:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788536063.881101:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788536063.889985:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589305600 00000100:00100000:1.0:1788536063.889999:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589305600 00000100:00100000:1.0:1788536063.890130:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788536063.890141:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+5:2358:x1875415589305600:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788536063.890225:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+5:2358:x1875415589305600:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 85us (14524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536063.890232:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00080000:2.0:1788536063.899276:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788536064.271788:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536065.295097:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536066.187037:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536066.187142:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589305728 00000100:00100000:1.0:1788536066.187151:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589305728 00000100:00100000:1.0:1788536066.187228:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788536066.187240:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+6:14418:x1875415589305728:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788536066.187274:0:15727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536066.187294:0:15727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4dde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515aea expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.187357:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4de5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.187372:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4de5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.187384:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4de5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.187398:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4dec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.187404:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4dec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.187410:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4dec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.187968:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d4df3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.187980:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d4df3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.187988:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d4df3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788536066.188013:0:15727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788536066.188022:0:15727:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788536066.188057:0:15727:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d4df3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188068:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4de5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188075:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4de5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188081:0:15727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4de5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188087:0:15727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788536066.188092:0:15727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4de5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188101:0:15727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4de5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188112:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ada00) 00010000:00010000:1.0:1788536066.188115:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788536066.188120:0:15727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4de5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188126:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4de5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188137:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4dec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188144:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4dec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188158:0:15727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4dec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188164:0:15727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788536066.188167:0:15727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4dec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188174:0:15727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4dec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188182:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97a9888ad300) 00010000:00010000:1.0:1788536066.188184:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788536066.188187:0:15727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4dec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188194:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4dec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188226:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b800/0x74f51638375d4dde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aea expref: 8 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188238:0:15727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0bc00/0x74f51638375d4df3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aea expref: 7 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.188245:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a9888ad000) 00010000:00010000:1.0:1788536066.188247:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788536066.188250:0:15727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0bc00, rc 0) 00000100:00100000:1.0:1788536066.188311:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+7:14418:x1875415589305728:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1074us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536066.188328:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00080000:2.0:1788536066.189227:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788536066.199280:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536066.199433:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589305984 00000100:00100000:2.0:1788536066.199444:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589305984 00000100:00100000:2.0:1788536066.199852:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788536066.199882:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+7:14418:x1875415589305984:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788536066.200211:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536066.200236:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4dfa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515af1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.200328:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e01 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.200342:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.200355:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.200407:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e08 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.200415:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.200421:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.201295:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4e0f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.201311:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4e0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.201320:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4e0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536066.201331:0:14321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788536066.202426:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.202462:0:14321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e01 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.202471:0:14321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.203113:0:14321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536066.203121:0:14321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.203131:0:14321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e01 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.203150:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a9888ad000) 00010000:00010000:2.0:1788536066.203153:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536066.203158:0:14321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.203164:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.203182:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.203188:0:14321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e08 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.203194:0:14321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.203198:0:14321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ea00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536066.203209:0:14321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.203215:0:14321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e08 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.203223:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97a990510900) 00010000:00010000:2.0:1788536066.203225:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536066.203228:0:14321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e08 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.203233:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e08 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.210147:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4dfa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515af1 expref: 10 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.210174:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fe00/0x74f51638375d4e0f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515af1 expref: 9 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.210183:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a990510600) 00010000:00010000:2.0:1788536066.210186:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536066.210189:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747fe00, rc 0) 00000100:00100000:2.0:1788536066.213384:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+9:14418:x1875415589305984:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 13502us (14092us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788536066.213397:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788536066.230329:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536066.230412:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589306112 00000100:00100000:1.0:1788536066.230422:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589306112 00000100:00100000:1.0:1788536066.230485:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788536066.230496:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+9:14418:x1875415589306112:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788536066.230611:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+9:14418:x1875415589306112:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 116us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536066.230619:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788536066.249656:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536066.249786:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589306240 00000100:00100000:3.0:1788536066.249797:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589306240 00000100:00100000:3.0:1788536066.249875:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:3.0:1788536066.249925:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+9:14424:x1875415589306240:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788536066.249962:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536066.249995:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d800/0x74f51638375d4e1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515af8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250241:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250256:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250268:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250283:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250289:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250296:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250489:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250497:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250504:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250510:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216d200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788536066.250520:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250528:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250540:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ada00) 00010000:00010000:3.0:1788536066.250543:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788536066.250548:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250554:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250579:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250586:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250591:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250596:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216c200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788536066.250599:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250605:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250612:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97a997503200) 00010000:00010000:3.0:1788536066.250615:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788536066.250625:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250630:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250664:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d800/0x74f51638375d4e1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515af8 expref: 10 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250674:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ada00) 00010000:00010000:3.0:1788536066.250677:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788536066.250680:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d800/0x74f51638375d4e1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515af8 expref: 10 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.250690:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216d800, rc 0) 00000100:00100000:3.0:1788536066.250758:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+9:14424:x1875415589306240:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 874us (1112us total) trans 0 rc 301/301 00000100:00100000:3.0:1788536066.250765:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788536066.253968:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536066.254132:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589306368 00000100:00100000:0.0:1788536066.254143:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589306368 00000100:00100000:0.0:1788536066.254231:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788536066.254242:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4ebbde98-87ac-49fa-9722-b860a25414cf+9:14424:x1875415589306368:12345-192.168.203.12@tcp:700:lfs.0 00000100:00100000:0.0:1788536066.254327:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4ebbde98-87ac-49fa-9722-b860a25414cf+9:14424:x1875415589306368:12345-192.168.203.12@tcp:700:lfs.0 Request processed in 87us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536066.254335:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788536066.256671:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536066.256741:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589306624 00000100:00100000:1.0:1788536066.256751:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589306624 00000100:00100000:1.0:1788536066.256813:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788536066.256823:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+9:14424:x1875415589306624:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:1.0:1788536066.256881:0:15727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788536066.256929:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d4d60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515a73 expref: 9 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.256949:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ada00) 00010000:00010000:1.0:1788536066.256954:0:15727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788536066.257159:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.257174:0:15727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d4d98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ad5 expref: 5 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.257195:0:15727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.257226:0:15727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d4d98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ad5 expref: 5 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.257239:0:15727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d4d98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ad5 expref: 5 pid: 14322 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536066.257254:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15727:1875415607120384:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788536066.257341:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a98895e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788536066.261009:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536066.265108:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589306752 00000100:00100000:3.0:1788536066.265124:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589306752 00010000:00010000:3.0:1788536066.265202:0:14305:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d4d98 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ad5 expref: 6 pid: 14322 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536066.265238:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788536066.265248:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+6:2356:x1875415589306752:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788536066.265263:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536066.265270:0:14305:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d4d98 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ad5 expref: 6 pid: 14322 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.265301:0:14305:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d4d98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ad5 expref: 6 pid: 14322 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.265324:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ada00) 00010000:00010000:3.0:1788536066.265329:0:14305:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.265338:0:14305:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.265345:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.265377:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536066.265435:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+6:2356:x1875415589306752:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 187us (4434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536066.265442:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:1.0:1788536066.265628:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788536066.272869:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a980031000/0x74f51638375d4d98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ad5 expref: 5 pid: 14322 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536066.272929:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15727:1875415607120384:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788536066.272957:0:15727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.272967:0:15727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.272972:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.272994:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4e39 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.273005:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4e39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.273014:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4e39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536066.274314:0:15727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788536066.274331:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.274341:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.274350:0:15727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.274356:0:15727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0b200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536066.274367:0:15727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.274375:0:15727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.274389:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a9888ada00) 00010000:00010000:2.0:1788536066.274391:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536066.274396:0:15727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.274401:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0b200/0x74f51638375d4e32 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788536066.274420:0:15727:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000aafaf101 reply state 0000000054747795 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4e39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536066.274428:0:15727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788536066.274527:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+10:14424:x1875415589306624:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 17703us (17862us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788536066.274537:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00010000:00010000:1.0:1788536066.281219:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4e39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.281237:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4e39 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.281244:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4e39 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.281249:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788536066.281253:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4e39 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.281261:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4e39 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.281299:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97a990510900) 00010000:00010000:1.0:1788536066.281303:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788536066.281308:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4e39 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.281315:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4e39 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.318305:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536066.362595:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536066.362676:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589306880 00000100:00100000:2.0:1788536066.362690:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589306880 00000100:00100000:2.0:1788536066.362749:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1788536066.362759:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+9:14432:x1875415589306880:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:2.0:1788536066.362784:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536066.362812:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515aff expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.362877:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.362932:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.362944:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536066.362980:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788536066.362984:0:14320:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788536066.363021:0:14320:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.363045:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aff expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.363063:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e600/0x74f51638375d4e47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515aff expref: 10 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.363072:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a990510800) 00010000:00010000:2.0:1788536066.363075:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788536066.363078:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747e600, rc 0) 00000100:00100000:2.0:1788536066.363131:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+10:14432:x1875415589306880:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 373us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536066.363139:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:0.0:1788536066.410376:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536066.411052:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589307008 00000100:00100000:3.0:1788536066.411062:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589307008 00000100:00100000:3.0:1788536066.411122:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788536066.411133:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+5:14433:x1875415589307008:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788536066.411152:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536066.411172:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b06 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.411240:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d800/0x74f51638375d4e55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.411265:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d800/0x74f51638375d4e55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.411278:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d800/0x74f51638375d4e55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788536066.411311:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788536066.411315:0:14322:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788536066.411337:0:14322:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d800/0x74f51638375d4e55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.411361:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b06 expref: 7 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.411379:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d800/0x74f51638375d4e55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b06 expref: 6 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.411389:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a990510800) 00010000:00010000:3.0:1788536066.411393:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788536066.411397:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216d800, rc 0) 00000100:00100000:3.0:1788536066.411456:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+6:14433:x1875415589307008:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 325us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536066.411464:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000001:00080000:3.0:1788536066.413805:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000100:00100000:0.0:1788536066.414081:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536066.414127:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589307136 00000100:00100000:2.0:1788536066.414138:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589307136 00000100:00100000:2.0:1788536066.414257:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788536066.414269:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+6:14433:x1875415589307136:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788536066.414288:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536066.414322:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b0d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.414386:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4e63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.414400:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4e63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.414412:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4e63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.414427:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4e6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.414433:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4e6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.414440:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4e6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.414738:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4e71 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.414748:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4e71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.414756:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4e71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536066.414787:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788536066.414790:0:14320:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788536066.414806:0:14320:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4e71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.414825:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4e63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.414832:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4e63 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.414839:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4e63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415093:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536066.415098:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4e63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415106:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4e63 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415118:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a990510800) 00010000:00010000:2.0:1788536066.415122:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536066.415127:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4e63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415133:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4e63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415146:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4e6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415152:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4e6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415158:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4e6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415169:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536066.415173:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4e6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415179:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4e6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415186:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97a990510b00) 00010000:00010000:2.0:1788536066.415189:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536066.415192:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4e6a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415198:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4e6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415230:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b0d expref: 8 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415243:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4e71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b0d expref: 7 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.415250:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a990510e00) 00010000:00010000:2.0:1788536066.415252:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788536066.415255:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747e800, rc 0) 00000100:00100000:2.0:1788536066.415309:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+7:14433:x1875415589307136:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1042us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536066.415317:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:0.0:1788536066.424079:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536066.424174:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589307392 00000100:00100000:1.0:1788536066.424185:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589307392 00000100:00100000:2.0:1788536066.424385:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1788536066.424409:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:801f3f5f-e678-4c00-91a4-f7506520d14a+7:14433:x1875415589307392:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788536066.424432:0:15727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536066.424451:0:15727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4e78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b14 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536066.424547:0:15727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788536066.424797:0:15727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4e78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b14 expref: 9 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.424828:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a990510800) 00010000:00010000:2.0:1788536066.424831:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788536066.424836:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4e78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b14 expref: 9 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.425120:0:15727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747e000, rc 0) 00000100:00100000:2.0:1788536066.425190:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:801f3f5f-e678-4c00-91a4-f7506520d14a+8:14433:x1875415589307392:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 784us (1120us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788536066.425199:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:0.0:1788536066.436355:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536066.436406:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589307648 00000100:00100000:2.0:1788536066.436417:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589307648 00000100:00100000:2.0:1788536066.436518:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1788536066.436529:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+8:14433:x1875415589307648:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:2.0:1788536066.436594:0:14320:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788536066.436621:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4e71 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b0d expref: 8 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.436642:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a990510e00) 00010000:00010000:2.0:1788536066.436669:0:14320:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788536066.436692:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e86 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.436706:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.436717:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788536066.437654:0:14320:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000006398fbe reply state 00000000b475ae8b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536066.437668:0:14320:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788536066.437676:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788536066.437882:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+9:14433:x1875415589307648:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 1352us (1534us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788536066.437909:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1788536066.441319:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536066.442418:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589307904 00000100:00100000:1.0:1788536066.442434:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589307904 00000100:00100000:1.0:1788536066.442501:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:1.0:1788536066.442511:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+9:14433:x1875415589307904:12345-192.168.203.12@tcp:35:lfs.0 00010000:00010000:3.0:1788536066.442950:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.442964:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e86 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.442990:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e86 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.442996:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ea00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788536066.443001:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e86 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.443008:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e86 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.443025:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a990510b00) 00010000:00010000:3.0:1788536066.443029:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788536066.443033:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e86 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.443040:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4e86 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536066.443207:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+9:14433:x1875415589307904:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 696us (1896us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788536066.443216:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1788536066.447023:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536066.447370:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589308160 00000100:00100000:3.0:1788536066.447381:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589308160 00000100:00100000:3.0:1788536066.447444:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:3.0:1788536066.447455:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+9:14433:x1875415589308160:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788536066.447479:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536066.447500:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b1b expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.447588:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.447603:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.447630:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.447646:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4e9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.447653:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4e9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.447661:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4e9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788536066.448336:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788536066.448423:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448433:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448440:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448447:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216d200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788536066.448451:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448459:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448472:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a990510800) 00010000:00010000:3.0:1788536066.448475:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788536066.448487:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448495:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4e94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448510:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4e9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448517:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4e9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448524:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4e9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448530:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216da00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788536066.448533:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4e9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448539:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4e9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448547:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97a997503800) 00010000:00010000:3.0:1788536066.448550:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788536066.448553:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4e9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448559:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4e9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448614:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e8d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b1b expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448637:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a990510800) 00010000:00010000:3.0:1788536066.448640:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788536066.448644:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4e8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b1b expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.448656:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216c200, rc 0) 00000100:00100000:3.0:1788536066.450273:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+10:14433:x1875415589308160:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2810us (3248us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788536066.450284:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:0.0:1788536066.453293:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536066.453374:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589308288 00000100:00100000:3.0:1788536066.453384:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589308288 00000100:00100000:3.0:1788536066.453479:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:3.0:1788536066.453490:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+10:14433:x1875415589308288:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788536066.453513:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536066.453535:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d4ea9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b22 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.453631:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ce00/0x74f51638375d4eb0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.453645:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ce00/0x74f51638375d4eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.453656:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ce00/0x74f51638375d4eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788536066.453678:0:14321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788536066.453694:0:14321:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788536066.453829:0:14321:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ce00/0x74f51638375d4eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.454131:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d4ea9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b22 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.454151:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ce00/0x74f51638375d4eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b22 expref: 11 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.454161:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a997503200) 00010000:00010000:3.0:1788536066.454163:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788536066.454168:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216ce00, rc 0) 00000100:00100000:3.0:1788536066.454254:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+11:14433:x1875415589308288:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 765us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536066.454262:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1788536066.458021:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536066.458508:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589308416 00000100:00100000:0.0:1788536066.458518:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589308416 00000100:00100000:0.0:1788536066.458634:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:0.0:1788536066.458646:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+11:14433:x1875415589308416:12345-192.168.203.12@tcp:37:lfs.0 00000100:00100000:2.0:1788536066.463711:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:801f3f5f-e678-4c00-91a4-f7506520d14a+11:14433:x1875415589308416:12345-192.168.203.12@tcp:37:lfs.0 Request processed in 5050us (5682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536066.463724:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:0.0:1788536066.466606:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536066.466695:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589308672 00000100:00100000:1.0:1788536066.466707:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589308672 00000100:00100000:1.0:1788536066.466772:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788536066.466782:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99cbc3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+11:14433:x1875415589308672:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788536066.467288:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99cbc3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+12:14433:x1875415589308672:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 504us (689us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788536066.467296:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1788536066.506610:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536066.506673:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589308800 00000100:00100000:2.0:1788536066.506682:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589308800 00000100:00100000:2.0:1788536066.507077:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1788536066.507087:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+8:14439:x1875415589308800:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788536066.507108:0:15727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536066.507126:0:15727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4eb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b29 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507181:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4ebe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507205:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4ebe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507216:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4ebe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507229:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ec5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507235:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507240:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507466:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4ecc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507473:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4ecc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507479:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4ecc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536066.507502:0:15727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788536066.507505:0:15727:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788536066.507536:0:15727:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4ecc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507547:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4ebe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507559:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4ebe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507582:0:15727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4ebe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507587:0:15727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536066.507592:0:15727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4ebe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507599:0:15727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4ebe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507612:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a990510800) 00010000:00010000:2.0:1788536066.507614:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536066.507619:0:15727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4ebe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507624:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4ebe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507636:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507641:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507646:0:15727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507651:0:15727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536066.507659:0:15727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507665:0:15727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507673:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97a990510e00) 00010000:00010000:2.0:1788536066.507675:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536066.507678:0:15727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ec5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507684:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ec5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507713:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4eb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b29 expref: 10 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507796:0:15727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f200/0x74f51638375d4ecc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b29 expref: 9 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.507804:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a997503200) 00010000:00010000:2.0:1788536066.507807:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788536066.507810:0:15727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747f200, rc 0) 00000100:00100000:2.0:1788536066.508018:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+9:14439:x1875415589308800:12345-192.168.203.12@tcp:101:bash.0 Request processed in 931us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536066.508026:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1788536066.511090:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536066.512046:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589309056 00000100:00100000:2.0:1788536066.512080:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589309056 00000100:00100000:2.0:1788536066.512180:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1788536066.512192:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+9:14439:x1875415589309056:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788536066.512235:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536066.512260:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4ed3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b30 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.512538:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.512551:0:14320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ce00/0x74f51638375d4eb0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b22 expref: 11 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.512557:0:14320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.512674:0:14320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ce00/0x74f51638375d4eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b22 expref: 11 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.512692:0:14320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ce00/0x74f51638375d4eb0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b22 expref: 11 pid: 14321 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536066.512710:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14320:1875415607120512:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788536066.512963:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a984ed8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788536066.518640:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536066.518739:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589309184 00000100:00100000:3.0:1788536066.518750:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589309184 00010000:00010000:3.0:1788536066.518795:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ce00/0x74f51638375d4eb0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b22 expref: 12 pid: 14321 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536066.518844:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788536066.518855:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+12:2356:x1875415589309184:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788536066.518872:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536066.518880:0:14307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ce00/0x74f51638375d4eb0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b22 expref: 12 pid: 14321 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.518940:0:14307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ce00/0x74f51638375d4eb0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b22 expref: 12 pid: 14321 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.518994:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a997503200) 00010000:00010000:3.0:1788536066.519000:0:14307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.519011:0:14307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.519019:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536066.519056:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536066.519112:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+12:2356:x1875415589309184:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 258us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536066.519119:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00010000:00010000:2.0:1788536066.519760:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ce00/0x74f51638375d4eb0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b22 expref: 11 pid: 14321 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536066.519779:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14320:1875415607120512:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788536066.519800:0:14320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.519822:0:14320:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.519828:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.519851:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4ee1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.519862:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.519870:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.521229:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ee8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.521244:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.521254:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536066.521266:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788536066.521294:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.521301:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.521309:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.521324:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ea00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536066.521329:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.521337:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.521349:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a997503200) 00010000:00010000:2.0:1788536066.521352:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536066.521356:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.521362:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4eda lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788536066.521376:0:14320:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000025a6efdc reply state 000000000ffdec13 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536066.521385:0:14320:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788536066.521421:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4ed3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b30 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.521436:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b30 expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.521444:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:2.0:1788536066.521446:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788536066.521449:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747f800, rc 0) 00000100:00100000:2.0:1788536066.521592:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+12:14439:x1875415589309056:12345-192.168.203.12@tcp:101:bash.0 Request processed in 9402us (10563us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788536066.521609:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00010000:00010000:1.0:1788536066.526406:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.526423:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4ee1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.526446:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.526453:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788536066.526458:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.526467:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4ee1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.526484:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff97a990510e00) 00010000:00010000:1.0:1788536066.526487:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788536066.526492:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4ee1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.526499:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e800/0x74f51638375d4ee1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536066.543609:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536066.543711:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589309312 00000100:00100000:2.0:1788536066.544242:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589309312 00000100:00100000:2.0:1788536066.544316:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1788536066.544326:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+11:14439:x1875415589309312:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788536066.544352:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536066.544372:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4ef6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b37 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.544441:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4efd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.544456:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4efd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.544469:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4efd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536066.544507:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788536066.544511:0:14322:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788536066.544529:0:14322:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4efd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.544539:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4efd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.544574:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4ef6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b37 expref: 13 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.544594:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4efd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b37 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.544618:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:2.0:1788536066.544620:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788536066.544623:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747ea00, rc 0) 00000100:00100000:2.0:1788536066.545342:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+12:14439:x1875415589309312:12345-192.168.203.12@tcp:101:bash.0 Request processed in 1013us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536066.545353:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788536066.549447:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536066.549501:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589309568 00000100:00100000:2.0:1788536066.549511:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589309568 00000100:00100000:2.0:1788536066.549575:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788536066.549586:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+12:14439:x1875415589309568:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1788536066.550175:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+13:14439:x1875415589309568:12345-192.168.203.12@tcp:35:bash.0 Request processed in 588us (735us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788536066.550184:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000040:00080000:0.0:1788536066.574618:0:14353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788536066.671996:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536066.672232:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589309824 00000100:00100000:1.0:1788536066.672242:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589309824 00000100:00100000:1.0:1788536066.672314:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:1.0:1788536066.672325:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+13:14449:x1875415589309824:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788536066.672348:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536066.672366:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b3e expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788536066.672454:0:14321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788536066.672579:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f04 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b3e expref: 15 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.672613:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a990510800) 00010000:00010000:1.0:1788536066.672616:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788536066.672622:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b3e expref: 15 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.672638:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a200, rc 0) 00000100:00100000:1.0:1788536066.672711:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+14:14449:x1875415589309824:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 383us (720us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788536066.672718:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:3.0:1788536066.675228:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536066.676156:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589310080 00000100:00100000:0.0:1788536066.676167:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589310080 00000100:00100000:0.0:1788536066.676232:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1788536066.676243:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+14:14449:x1875415589310080:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788536066.676463:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+15:14449:x1875415589310080:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 221us (1241us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788536066.676472:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1788536066.719212:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536066.719317:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589310336 00000100:00100000:2.0:1788536066.719326:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589310336 00000100:00100000:2.0:1788536066.719384:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:2.0:1788536066.719395:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+15:14452:x1875415589310336:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788536066.719417:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536066.719449:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f12 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b45 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.719544:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4f19 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.719572:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4f19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.719601:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4f19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536066.719613:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788536066.719736:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f12 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b45 expref: 18 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.719755:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4f19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b45 expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536066.719763:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:2.0:1788536066.719766:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788536066.719769:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747e000, rc 0) 00000100:00100000:2.0:1788536066.719832:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+17:14452:x1875415589310336:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 439us (631us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788536066.719839:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1788536066.723681:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536066.723787:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589310464 00000100:00100000:1.0:1788536066.723799:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589310464 00000100:00100000:1.0:1788536066.723862:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:1.0:1788536066.723872:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+17:14452:x1875415589310464:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788536066.723981:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f27 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.724000:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.724012:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.724048:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.724056:0:14321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f27 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.724080:0:14321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.724086:0:14321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788536066.724091:0:14321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.724100:0:14321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f27 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.724112:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:1.0:1788536066.724115:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788536066.724120:0:14321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f27 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536066.724127:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f27 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536066.724200:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+17:14452:x1875415589310464:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 329us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536066.724208:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1788536066.728866:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536066.728961:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536066.729065:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589310848 00000100:00100000:0.0:1788536066.729076:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589310848 00000100:00100000:0.0:1788536066.729142:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788536066.729153:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+17:2357:x1875415589310848:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788536066.729170:0:14306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788536066.729194:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747e000/0x74f51638375d4f19 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b45 expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536066.729235:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:0.0:1788536066.729241:0:14306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788536066.729307:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+16:2357:x1875415589310848:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 156us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536066.729315:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1788536066.729934:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589310720 00000100:00100000:2.0:1788536066.729943:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589310720 00000100:00100000:2.0:1788536066.729990:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788536066.729998:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+16:14452:x1875415589310720:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788536066.730524:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+17:14452:x1875415589310720:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 523us (1663us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788536066.730533:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1788536067.199422:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536067.218611:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589311104 00000100:00100000:2.0:1788536067.219441:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589311104 00000100:00100000:2.0:1788536067.224655:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:2.0:1788536067.224693:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+17:14483:x1875415589311104:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1788536067.224730:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536067.224750:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f2e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b4c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.224839:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4f35 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.224852:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4f35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.224867:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4f35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536067.224878:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788536067.225047:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f2e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b4c expref: 20 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.225067:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4f35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b4c expref: 19 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.225083:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:2.0:1788536067.225086:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788536067.225090:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747f000, rc 0) 00000100:00100000:2.0:1788536067.225171:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+19:14483:x1875415589311104:12345-192.168.203.12@tcp:101:cat.0 Request processed in 503us (25759us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788536067.225180:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1788536067.235868:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536067.236371:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589311232 00000100:00100000:0.0:1788536067.236382:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589311232 00000100:00100000:0.0:1788536067.238060:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1788536067.238084:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b91c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+19:2357:x1875415589311232:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788536067.238102:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788536067.238130:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d4f35 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b4c expref: 19 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536067.238150:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:0.0:1788536067.238155:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788536067.238862:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b91c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+18:2357:x1875415589311232:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 785us (3000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.238871:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1788536067.242934:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536067.243059:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589311488 00000100:00100000:1.0:1788536067.243070:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589311488 00000100:00100000:1.0:1788536067.243130:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1788536067.243140:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+18:14483:x1875415589311488:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:1.0:1788536067.243448:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+19:14483:x1875415589311488:12345-192.168.203.12@tcp:35:cat.0 Request processed in 308us (521us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788536067.243473:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:0.0:1788536067.341118:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788536067.341256:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607120640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788536067.341328:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.341397:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607120640 00000100:00100000:0.0:1788536067.341405:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607120640 00000100:00100000:0.0:1788536067.341471:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788536067.341480:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607120640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788536067.341525:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788536067.341577:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607120640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.341584:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788536067.341604:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788536067.341647:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536067.341800:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607120640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788536067.342011:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49edad1-b206-4ca7-85f1-c4b27706521e:3310:1875415607120768:0@lo:400:kworker.0 00000100:00100000:3.0:1788536067.342117:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536067.343163:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607120896:0@lo:400:kworker.0 00000100:00100000:1.0:1788536067.343213:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536067.343538:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607120896 00000100:00100000:2.0:1788536067.343544:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607120896 00000100:00100000:2.0:1788536067.343610:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788536067.343631:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607120896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536067.343692:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607120896:12345-0@lo:400:kworker.0 Request processed in 62us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536067.343699:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788536067.343731:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788536067.343760:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607120896:0@lo:400:kworker.0 00000100:00100000:2.0:1788536067.343785:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607121024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788536067.343811:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536067.343853:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607120768 00000100:00100000:2.0:1788536067.343857:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607120768 00000100:00100000:2.0:1788536067.343881:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788536067.343906:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+19:3310:x1875415607120768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536067.344087:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607121024 00000100:00100000:1.0:1788536067.344091:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607121024 00000100:00100000:1.0:1788536067.344115:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788536067.344121:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607121024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788536067.344157:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788536067.344194:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607121024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536067.344200:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788536067.344232:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607121024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788536067.349526:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607121408:0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.349608:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.349646:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788536067.349652:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607121280:0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.349672:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.349697:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788536067.349706:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607121152:0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.349729:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.349759:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607121408 00000100:00100000:0.0:1788536067.349766:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607121408 00000100:00100000:0.0:1788536067.349817:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607121280 00000100:00100000:0.0:1788536067.349819:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607121280 00000100:00100000:0.0:1788536067.349837:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607121152 00000100:00100000:0.0:1788536067.349840:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607121152 00000100:00100000:0.0:1788536067.349856:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788536067.349864:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607121408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.349942:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607121408:12345-0@lo:400:kworker.0 Request processed in 79us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.349950:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788536067.349968:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788536067.349993:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607121280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.350041:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875415607121280:12345-0@lo:400:kworker.0 Request processed in 50us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.350047:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788536067.350060:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788536067.350066:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607121152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.350096:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607121152:12345-0@lo:400:kworker.0 Request processed in 30us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.350102:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788536067.350119:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788536067.350147:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875415607121280:0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.350158:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607121408:0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.350187:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607121152:0@lo:400:kworker.0 00000100:00100000:2.0:1788536067.353422:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+19:3310:x1875415607120768:12345-0@lo:400:kworker.0 Request processed in 9525us (11294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536067.353436:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788536067.355826:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c49edad1-b206-4ca7-85f1-c4b27706521e:3310:1875415607120768:0@lo:400:kworker.0 00000100:00100000:3.0:1788536067.365300:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536067.365679:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589311744 00000100:00100000:0.0:1788536067.365690:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589311744 00000100:00100000:0.0:1788536067.365761:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1788536067.365772:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+19:14489:x1875415589311744:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1788536067.365795:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536067.365813:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ae00/0x74f51638375d4f43 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b53 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.366237:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.366257:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.366270:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788536067.366282:0:14321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788536067.366447:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4ae00/0x74f51638375d4f43 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b53 expref: 22 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.366479:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b53 expref: 21 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.366507:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:1.0:1788536067.366509:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788536067.366513:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a200, rc 0) 00000100:00100000:1.0:1788536067.366586:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+21:14489:x1875415589311744:12345-192.168.203.12@tcp:101:dd.0 Request processed in 816us (1295us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788536067.366595:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1788536067.375544:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536067.375806:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589312000 00000100:00100000:2.0:1788536067.375816:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589312000 00000100:00100000:2.0:1788536067.375932:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:2.0:1788536067.375943:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+21:14489:x1875415589312000:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:2.0:1788536067.376003:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788536067.376231:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0a200/0x74f51638375d4f4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b53 expref: 21 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.376257:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4efd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b37 expref: 20 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.376287:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:2.0:1788536067.376292:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788536067.376592:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f58 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.376607:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.376617:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788536067.377413:0:14322:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788536067.378219:0:14322:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000003ae156b3 reply state 00000000180a36d0 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536067.378232:0:14322:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788536067.378363:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+22:14489:x1875415589312000:12345-192.168.203.12@tcp:36:dd.0 Request processed in 2419us (2825us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788536067.378373:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000020:00080000:2.0:1788536067.378378:0:14322:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788536067.380687:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.380704:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f58 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.380711:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.380716:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fc00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536067.380736:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.380744:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f58 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.380761:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:2.0:1788536067.380764:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536067.380768:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f58 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.380774:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f58 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536067.563759:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536067.570522:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589312256 00000100:00100000:2.0:1788536067.571101:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589312256 00000100:00100000:2.0:1788536067.571245:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788536067.571257:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+21:14489:x1875415589312256:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:2.0:1788536067.571527:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+22:14489:x1875415589312256:12345-192.168.203.12@tcp:35:dd.0 Request processed in 272us (7776us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788536067.571535:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788536067.854126:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536067.855707:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589312384 00000100:00100000:3.0:1788536067.855742:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589312384 00000100:00100000:3.0:1788536067.855808:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1788536067.855819:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+22:14503:x1875415589312384:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:3.0:1788536067.856095:0:15727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536067.856116:0:15727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d4f5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b5a expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856184:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4f66 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856199:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4f66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856211:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4f66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856224:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4f6d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856232:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4f6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856238:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4f6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856321:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4f74 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856330:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4f74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856337:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4f74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788536067.856379:0:15727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788536067.856385:0:15727:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788536067.856422:0:15727:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4f74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856434:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4f74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856443:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4f66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856448:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4f66 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856455:0:15727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4f66 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856460:0:15727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216c200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788536067.856464:0:15727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4f66 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856471:0:15727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4f66 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856483:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a997503200) 00010000:00010000:3.0:1788536067.856486:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788536067.856490:0:15727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4f66 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856497:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d4f66 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856521:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4f6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856528:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4f6d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856534:0:15727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4f6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856540:0:15727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216da00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788536067.856543:0:15727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4f6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856550:0:15727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4f6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856966:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff97a997503800) 00010000:00010000:3.0:1788536067.856969:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788536067.856972:0:15727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4f6d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.856979:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d4f6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.857021:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d4f5f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b5a expref: 24 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.857036:0:15727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4f74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b5a expref: 23 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.857056:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:3.0:1788536067.857058:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788536067.857061:0:15727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216d200, rc 0) 00000100:00100000:3.0:1788536067.857186:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+23:14503:x1875415589312384:12345-192.168.203.12@tcp:101:stat.0 Request processed in 1367us (3066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536067.857195:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1788536067.930682:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536067.930791:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589312640 00000100:00100000:2.0:1788536067.930802:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589312640 00000100:00100000:2.0:1788536067.930873:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1788536067.930884:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+23:14509:x1875415589312640:12345-192.168.203.12@tcp:36:truncate.0 00010000:00010000:2.0:1788536067.930971:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788536067.931001:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d200/0x74f51638375d4f74 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b5a expref: 23 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.931052:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:2.0:1788536067.931058:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788536067.931253:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f7b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.931267:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536067.931277:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788536067.931327:0:14322:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788536067.931353:0:14322:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000260011cb reply state 00000000577d8c37 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536067.931361:0:14322:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788536067.931471:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+25:14509:x1875415589312640:12345-192.168.203.12@tcp:36:truncate.0 Request processed in 588us (798us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788536067.931478:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000020:00080000:2.0:1788536067.931483:0:14322:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788536067.943566:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.943584:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f7b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.943592:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.943599:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fc00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788536067.943603:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.943611:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f7b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.943627:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:1.0:1788536067.943630:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788536067.943634:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f7b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.943640:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d4f7b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536068.157212:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536068.157469:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589312768 00000100:00100000:0.0:1788536068.157492:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589312768 00000100:00100000:0.0:1788536068.157576:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788536068.157592:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+24:14523:x1875415589312768:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:0.0:1788536068.157616:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536068.157636:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4f82 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b61 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157698:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4f89 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157712:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4f89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157723:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4f89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157736:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4f90 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157742:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4f90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157748:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4f90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157826:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4f97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157845:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4f97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157852:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4f97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788536068.157929:0:14321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788536068.157933:0:14321:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788536068.157953:0:14321:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4f97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157965:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4f97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157973:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4f89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157979:0:14321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4f89 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157986:0:14321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4f89 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.157992:0:14321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4be00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788536068.157996:0:14321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4f89 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.158004:0:14321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4f89 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.158014:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a997503200) 00010000:00010000:0.0:1788536068.158017:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536068.158031:0:14321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4f89 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.158038:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4f89 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.158063:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4f90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.158069:0:14321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4f90 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.158075:0:14321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4f90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.158080:0:14321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788536068.158083:0:14321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4f90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.158090:0:14321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4f90 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.158098:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff97a983911c00) 00010000:00010000:0.0:1788536068.158100:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536068.158103:0:14321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4f90 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.158109:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4f90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.158140:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4f82 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b61 expref: 26 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.158152:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4f97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b61 expref: 25 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.158170:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:0.0:1788536068.158172:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788536068.158175:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4a200, rc 0) 00000100:00100000:0.0:1788536068.158249:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+25:14523:x1875415589312768:12345-192.168.203.12@tcp:101:stat.0 Request processed in 663us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536068.158256:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00080000:2.0:1788536068.158433:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788536068.315096:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536068.315293:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589313024 00000100:00100000:2.0:1788536068.315304:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589313024 00000100:00100000:2.0:1788536068.315384:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1788536068.315394:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+25:14533:x1875415589313024:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788536068.315415:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536068.315435:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4f9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b68 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536068.315542:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788536068.315690:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4f9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b68 expref: 27 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.315708:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a990510800) 00010000:00010000:2.0:1788536068.315711:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788536068.315717:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d4f9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b68 expref: 27 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.315732:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747ea00, rc 0) 00000100:00100000:2.0:1788536068.315807:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+26:14533:x1875415589313024:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 414us (723us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1788536068.315815:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1788536068.338875:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536068.342634:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589313280 00000100:00100000:1.0:1788536068.342648:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589313280 00000100:00100000:1.0:1788536068.342726:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1788536068.342736:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a99cbc1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+26:14533:x1875415589313280:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788536068.343241:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a99cbc1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+27:14533:x1875415589313280:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 504us (4376us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788536068.343251:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00010000:00010000:3.0:1788536068.366047:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788536068.421651:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536068.421753:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589313536 00000100:00100000:0.0:1788536068.421763:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589313536 00000100:00100000:0.0:1788536068.421825:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788536068.421845:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+27:14539:x1875415589313536:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788536068.421870:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536068.421918:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4fac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b6f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.422033:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.422049:0:14321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ee8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b30 expref: 28 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.422058:0:14321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4f97 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b61 expref: 28 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.422083:0:14321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.422119:0:14321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4f97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b61 expref: 28 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.422134:0:14321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4f97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b61 expref: 28 pid: 14321 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536068.422147:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf134380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14321:1875415607121536:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788536068.422251:0:14321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b30 expref: 28 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.422261:0:14321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ee8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b30 expref: 28 pid: 14320 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536068.422270:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf134e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14321:1875415607121664:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788536068.422294:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788536068.431605:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536068.431650:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536068.431741:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589313664 00000100:00100000:2.0:1788536068.431750:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589313664 00010000:00010000:2.0:1788536068.431790:0:14306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4f97 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b61 expref: 29 pid: 14321 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536068.431846:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589313792 00000100:00100000:2.0:1788536068.431849:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589313792 00010000:00010000:2.0:1788536068.431865:0:14306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ee8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b30 expref: 30 pid: 14320 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536068.431881:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1788536068.431916:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7052c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+30:2355:x1875415589313664:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788536068.431946:0:14306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788536068.431955:0:14306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4f97 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b61 expref: 30 pid: 14321 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.431968:0:14306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4f97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b61 expref: 30 pid: 14321 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.431988:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:2.0:1788536068.431994:0:14306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.432001:0:14306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.432007:0:14306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788536068.432071:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7052c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+30:2355:x1875415589313664:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 182us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536068.432078:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1788536068.432137:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1788536068.432144:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0816a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+29:2355:x1875415589313792:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788536068.432151:0:14306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788536068.432156:0:14306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ee8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b30 expref: 29 pid: 14320 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.432165:0:14306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ee8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b30 expref: 29 pid: 14320 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.432187:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:2.0:1788536068.432190:0:14306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.432197:0:14306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.432205:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.432221:0:14306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788536068.432240:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0816a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+29:2355:x1875415589313792:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 97us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536068.432246:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00010000:00010000:0.0:1788536068.433711:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4f97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b61 expref: 28 pid: 14321 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536068.433732:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf134380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14321:1875415607121536:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788536068.433745:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d4ee8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b30 expref: 27 pid: 14320 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536068.433772:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf134e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14321:1875415607121664:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788536068.433797:0:14321:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.433806:0:14321:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.433812:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788536068.433841:0:14321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788536068.434058:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4fac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b6f expref: 28 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.434074:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b6f expref: 27 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.434084:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:0.0:1788536068.434087:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788536068.434091:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4a400, rc 0) 00000100:00100000:0.0:1788536068.434145:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+27:14539:x1875415589313536:12345-192.168.203.12@tcp:101:bash.0 Request processed in 12302us (12504us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788536068.434153:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:1.0:1788536068.436691:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536068.436782:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589314048 00000100:00100000:2.0:1788536068.436791:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589314048 00000100:00100000:2.0:1788536068.437012:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:2.0:1788536068.437034:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+27:14539:x1875415589314048:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:2.0:1788536068.437303:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fc1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.437321:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.437332:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788536068.437380:0:14322:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788536068.437407:0:14322:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000eea21295 reply state 0000000062715cad transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536068.437423:0:14322:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788536068.437516:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+30:14539:x1875415589314048:12345-192.168.203.12@tcp:36:bash.0 Request processed in 493us (892us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788536068.437522:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000020:00080000:2.0:1788536068.437526:0:14322:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788536068.439279:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.439295:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fc1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536068.439300:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:2.0:1788536068.439303:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fc1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.439310:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ee00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536068.439314:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fc1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.439322:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fc1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.439337:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:2.0:1788536068.439341:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536068.439345:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fc1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.439356:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fc1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536068.439370:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589314176 00000100:00100000:0.0:1788536068.439379:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589314176 00000100:00100000:0.0:1788536068.439430:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:0.0:1788536068.439439:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+29:14539:x1875415589314176:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788536068.439471:0:15727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536068.439487:0:15727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4fc8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b76 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.439530:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b76 expref: 30 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.439540:0:15727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b76 expref: 30 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.439566:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:0.0:1788536068.439569:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788536068.439572:0:15727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4be00, rc 0) 00000100:00100000:0.0:1788536068.439628:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+30:14539:x1875415589314176:12345-192.168.203.12@tcp:101:bash.0 Request processed in 191us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536068.439635:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:3.0:1788536068.444391:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536068.444442:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589314304 00000100:00100000:0.0:1788536068.444452:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589314304 00000100:00100000:0.0:1788536068.444513:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:0.0:1788536068.444524:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+30:14539:x1875415589314304:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788536068.444543:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536068.444582:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fcf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b7d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.444872:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4fd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.444927:0:14320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b6f expref: 31 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.444950:0:14320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4fd6 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.444989:0:14320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b6f expref: 31 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.445003:0:14320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b6f expref: 31 pid: 14321 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536068.445017:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf134e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14320:1875415607121792:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788536068.445099:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788536068.450373:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536068.450616:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589314432 00000100:00100000:3.0:1788536068.450626:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589314432 00010000:00010000:3.0:1788536068.450671:0:14306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b6f expref: 32 pid: 14321 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536068.450721:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1788536068.450732:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+32:2356:x1875415589314432:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788536068.450745:0:14306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536068.450752:0:14306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b6f expref: 32 pid: 14321 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.450766:0:14306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b6f expref: 32 pid: 14321 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.450800:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:3.0:1788536068.450806:0:14306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4fd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.450815:0:14306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.450823:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4fd6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.450842:0:14306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536068.450917:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+32:2356:x1875415589314432:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 187us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536068.450925:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00010000:00010000:0.0:1788536068.451036:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4fb3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b6f expref: 31 pid: 14321 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536068.451054:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf134e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14320:1875415607121792:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788536068.451079:0:14320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.451088:0:14320:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.451095:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788536068.451141:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788536068.451146:0:14320:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788536068.451165:0:14320:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.451204:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fcf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b7d expref: 31 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.451219:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b7d expref: 30 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.451227:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:0.0:1788536068.451230:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788536068.451242:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4b800, rc 0) 00000100:00100000:0.0:1788536068.451270:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+30:14539:x1875415589314304:12345-192.168.203.12@tcp:101:bash.0 Request processed in 6750us (6890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536068.451277:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788536068.457615:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536068.457922:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589314688 00000100:00100000:2.0:1788536068.457933:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589314688 00000100:00100000:2.0:1788536068.458001:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1788536068.458011:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+30:14539:x1875415589314688:12345-192.168.203.12@tcp:103:bash.0 00010000:00010000:2.0:1788536068.458216:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788536068.458332:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b800/0x74f51638375d4fd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b7d expref: 30 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.458357:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4be00/0x74f51638375d4fc8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b76 expref: 29 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.458367:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a990510400) 00010000:00010000:2.0:1788536068.458377:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788536068.458486:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+28:14539:x1875415589314688:12345-192.168.203.12@tcp:103:bash.0 Request processed in 476us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536068.458494:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1788536068.462335:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536068.462429:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589314816 00000100:00100000:0.0:1788536068.462440:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589314816 00000100:00100000:0.0:1788536068.466179:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:0.0:1788536068.466214:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+28:14539:x1875415589314816:12345-192.168.203.12@tcp:58:bash.0 00010000:00010000:0.0:1788536068.466327:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fdd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.466345:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fdd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.466357:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fdd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788536068.468726:0:14321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788536068.470539:0:14321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788536068.471115:0:14321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788536068.471517:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+28:14539:x1875415589314816:12345-192.168.203.12@tcp:58:bash.0 Request processed in 5318us (9185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536068.471529:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1788536068.474423:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536068.474526:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589314944 00000100:00100000:2.0:1788536068.474536:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589314944 00000100:00100000:2.0:1788536068.474614:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1788536068.474624:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+28:14539:x1875415589314944:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788536068.474645:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536068.474665:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fe4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b84 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.474720:0:14322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fdd lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.474749:0:14322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fe4 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b84 expref: 29 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.474767:0:14322:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fdd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.474780:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fe4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b84 expref: 29 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.474793:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a983911c00) 00010000:00010000:2.0:1788536068.474796:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788536068.474800:0:14322:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fe4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b84 expref: 29 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.474808:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747ee00, rc 0) 00000100:00100000:2.0:1788536068.476704:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+29:14539:x1875415589314944:12345-192.168.203.12@tcp:101:bash.0 Request processed in 2070us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536068.476717:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000040:00080000:0.0:1788536068.621198:0:14353:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788536068.621207:0:14353:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788536068.621258:0:14353:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788536068.621265:0:14353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788536068.621381:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf134e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14353:1875415607121920:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788536068.621459:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788536068.629511:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf134e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14353:1875415607121920:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788536068.631938:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536068.632141:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589315072 00000100:00100000:0.0:1788536068.632150:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589315072 00000100:00100000:0.0:1788536068.632207:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788536068.632218:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4ebbde98-87ac-49fa-9722-b860a25414cf+29:14540:x1875415589315072:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788536068.632289:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4ebbde98-87ac-49fa-9722-b860a25414cf+29:14540:x1875415589315072:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 Request processed in 74us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536068.632297:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788536068.633994:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536068.634103:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589315200 00000100:00100000:3.0:1788536068.634112:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589315200 00000100:00100000:3.0:1788536068.634160:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788536068.634168:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+29:14540:x1875415589315200:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788536068.634196:0:15727:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788536068.634296:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+29:14540:x1875415589315200:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 128us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536068.634303:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788536068.638299:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536068.638569:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589315328 00000100:00100000:0.0:1788536068.638580:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589315328 00000100:00100000:0.0:1788536068.638668:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1788536068.638678:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+29:14540:x1875415589315328:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788536068.638750:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4feb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.638768:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4feb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.638797:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4feb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.638855:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4ff2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.638864:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.638871:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.638921:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4ff9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.638929:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.638936:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788536068.638971:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788536068.638975:0:14320:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788536068.638989:0:14320:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.638998:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4feb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639003:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4feb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639033:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4feb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639040:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a400 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788536068.639044:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4feb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639051:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4feb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639062:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a990510600) 00010000:00010000:0.0:1788536068.639066:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536068.639070:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4feb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639077:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d4feb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639089:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639095:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4ff2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639101:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639106:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4aa00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788536068.639109:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639126:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4ff2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639134:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff97a983911600) 00010000:00010000:0.0:1788536068.639136:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536068.639139:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4ff2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639145:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d4ff2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639160:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639166:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4ff9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639172:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639177:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788536068.639180:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639185:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639193:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a983911c00) 00010000:00010000:0.0:1788536068.639195:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536068.639198:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4ff9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.639213:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d4ff9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536068.639290:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+29:14540:x1875415589315328:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 612us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536068.639298:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1788536068.648375:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536068.649243:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589315584 00000100:00100000:3.0:1788536068.649255:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589315584 00000100:00100000:3.0:1788536068.649331:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:3.0:1788536068.649342:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+29:14540:x1875415589315584:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788536068.649362:0:15727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536068.649382:0:15727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d5000 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b8b expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.649493:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d5007 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.649509:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d5007 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.649521:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d5007 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788536068.649532:0:15727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788536068.649646:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d5007 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.649654:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d5007 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.649660:0:15727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d5007 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.649666:0:15727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216de00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788536068.649670:0:15727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d5007 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.649678:0:15727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d5007 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.649699:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a983911c00) 00010000:00010000:3.0:1788536068.649702:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788536068.649707:0:15727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d5007 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.649714:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d5007 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.649758:0:15727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d5000 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b8b expref: 31 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.649768:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a990510600) 00010000:00010000:3.0:1788536068.649770:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788536068.649774:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d5000 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b8b expref: 31 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.649783:0:15727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216da00, rc 0) 00000100:00100000:3.0:1788536068.649853:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+30:14540:x1875415589315584:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 513us (1488us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1788536068.649861:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:1.0:1788536068.661157:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536068.661236:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589315712 00000100:00100000:0.0:1788536068.661246:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589315712 00000100:00100000:0.0:1788536068.661314:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:0.0:1788536068.661325:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+30:14540:x1875415589315712:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788536068.661359:0:14320:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788536068.661467:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+30:14540:x1875415589315712:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 144us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536068.661475:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1788536068.667359:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536068.667455:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589315968 00000100:00100000:3.0:1788536068.667465:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589315968 00000100:00100000:3.0:1788536068.667527:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:3.0:1788536068.667537:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+30:14540:x1875415589315968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788536068.667568:0:15727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536068.667588:0:15727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d5015 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b92 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788536068.668413:0:15727:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1788536068.668420:0:15727:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788536068.668463:0:15727:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788536068.668775:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d501c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.668790:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d501c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.668801:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d501c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.668863:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d5015 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b92 expref: 33 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.668882:0:15727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d501c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b92 expref: 32 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.668933:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a997503800) 00010000:00010000:3.0:1788536068.668936:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788536068.668940:0:15727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216de00, rc 0) 00000100:00100000:3.0:1788536068.669012:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+32:14540:x1875415589315968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1476us (1661us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788536068.669020:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1788536068.680087:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536068.685206:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589316224 00000100:00100000:0.0:1788536068.685221:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589316224 00000100:00100000:0.0:1788536068.685310:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1788536068.685321:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+32:14540:x1875415589316224:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788536068.685380:0:14320:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788536068.685406:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216de00/0x74f51638375d501c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b92 expref: 32 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685427:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a997503800) 00010000:00010000:0.0:1788536068.685451:0:14320:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788536068.685472:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d502a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685500:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d502a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685511:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d502a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685580:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5031 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x40b3331e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685589:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5031 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40b3331e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685596:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5031 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40b3331e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685659:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d502a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685666:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d502a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685673:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d502a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685678:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4a200 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788536068.685682:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d502a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685690:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d502a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685698:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a997503200) 00010000:00010000:0.0:1788536068.685709:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536068.685713:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d502a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685720:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d502a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685731:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5031 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40b3331e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685737:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5031 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40b3331e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685743:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5031 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40b3331e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685747:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4aa00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:0.0:1788536068.685750:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5031 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40b3331e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685765:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5031 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x40b3331e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685773:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x40b3331e (ffff97a983911600) 00010000:00010000:0.0:1788536068.685775:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536068.685778:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5031 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x40b3331e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.685784:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5031 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x40b3331e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536068.685862:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+31:14540:x1875415589316224:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 543us (5787us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788536068.685875:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1788536068.690414:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536068.690491:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589316352 00000100:00100000:3.0:1788536068.690502:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589316352 00000100:00100000:3.0:1788536068.690570:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788536068.690580:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+31:14540:x1875415589316352:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788536068.690624:0:15727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536068.690647:0:15727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d5038 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515b99 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.690681:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d503f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.690694:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d503f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.690705:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d503f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.690795:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216da00/0x74f51638375d5038 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b99 expref: 33 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.690812:0:15727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c200/0x74f51638375d503f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b99 expref: 32 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.690820:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a997503f00) 00010000:00010000:3.0:1788536068.690823:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788536068.690839:0:15727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216c200, rc 0) 00000100:00100000:3.0:1788536068.690933:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+32:14540:x1875415589316352:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 354us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536068.690941:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1788536068.693454:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536068.693542:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589316608 00000100:00100000:0.0:1788536068.693564:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589316608 00000100:00100000:0.0:1788536068.693628:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788536068.693647:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+32:14540:x1875415589316608:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788536068.693718:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5046 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.693733:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5046 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.693744:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5046 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788536068.694227:0:14320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1788536068.694253:0:14320:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 470825365098ns, next at 471825362230ns, rc = 0 00000004:00010000:1.0:1788536068.694332:0:14320:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000da452e03 reply state 00000000edee6d13 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5046 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536068.694341:0:14320:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788536068.694435:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+34:14540:x1875415589316608:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 789us (988us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1788536068.694453:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00010000:00010000:1.0:1788536068.696330:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5046 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.696345:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5046 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.696352:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5046 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.696374:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4aa00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788536068.696379:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5046 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.696387:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5046 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.696401:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a997503f00) 00010000:00010000:1.0:1788536068.696404:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788536068.696409:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5046 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.696414:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4aa00/0x74f51638375d5046 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536068.697916:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536068.698465:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589316736 00000100:00100000:3.0:1788536068.698476:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589316736 00000100:00100000:3.0:1788536068.698536:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:3.0:1788536068.698554:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+33:14540:x1875415589316736:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788536068.698590:0:15727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536068.698619:0:15727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d504d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515ba0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.698872:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d504d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ba0 expref: 34 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.698916:0:15727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d504d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ba0 expref: 34 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.698936:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a997503f00) 00010000:00010000:3.0:1788536068.698939:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788536068.698943:0:15727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216d000, rc 0) 00000100:00100000:3.0:1788536068.698995:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+34:14540:x1875415589316736:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 450us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536068.699002:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:2.0:1788536068.702069:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536068.703093:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589316864 00000100:00100000:1.0:1788536068.703105:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589316864 00000100:00100000:1.0:1788536068.703162:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788536068.703172:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+5:2356:x1875415589316864:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788536068.703508:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+6:2356:x1875415589316864:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 336us (1447us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788536068.703516:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00080000:2.0:1788536068.703859:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788536068.718955:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536068.719048:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589317120 00000100:00100000:0.0:1788536068.719059:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589317120 00000100:00100000:0.0:1788536068.719120:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1788536068.719130:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+34:14540:x1875415589317120:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788536068.719361:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+35:14540:x1875415589317120:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 231us (413us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788536068.719369:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1788536068.729600:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536068.729770:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589317376 00000100:00100000:3.0:1788536068.729779:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589317376 00000100:00100000:3.0:1788536068.729845:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:3.0:1788536068.729854:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+35:14540:x1875415589317376:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788536068.729995:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+35:14540:x1875415589317376:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 142us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536068.730003:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:2.0:1788536068.732443:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536068.732520:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589317504 00000100:00100000:0.0:1788536068.732530:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589317504 00000100:00100000:0.0:1788536068.732595:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1788536068.732605:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+35:14540:x1875415589317504:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788536068.732632:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536068.732665:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d5054 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515ba7 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.732743:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d505b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.732757:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d505b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.732769:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d505b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788536068.732807:0:14321:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788536068.732836:0:14321:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d505b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.732862:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a200/0x74f51638375d5054 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ba7 expref: 37 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.732880:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d505b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ba7 expref: 36 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.733139:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a997503f00) 00010000:00010000:0.0:1788536068.733142:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788536068.733147:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4a400, rc 0) 00000100:00100000:2.0:1788536068.734220:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+36:14540:x1875415589317504:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1609us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536068.734231:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1788536068.738528:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536068.738734:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589317632 00000100:00100000:3.0:1788536068.738743:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589317632 00000100:00100000:3.0:1788536068.738804:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788536068.738814:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+6:2355:x1875415589317632:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788536068.738856:0:15005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536068.738876:0:15005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000671678c3/0x74f51638375d5062 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515bae expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788536068.738936:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ae504, blocks: 0x1 00010000:00010000:3.0:1788536068.738957:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1788536068.738962:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788536068.738971:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000671678c3/0x74f51638375d5062 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bae expref: 7 pid: 15005 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.738990:0:15005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000671678c3/0x74f51638375d5062 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bae expref: 7 pid: 15005 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.739004:0:15005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9c216da00, rc 0) 00000100:00100000:3.0:1788536068.739064:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+7:2355:x1875415589317632:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 251us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536068.739071:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788536068.743970:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536068.744051:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589317888 00000100:00100000:1.0:1788536068.744061:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589317888 00000100:00100000:1.0:1788536068.744122:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788536068.744132:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+36:14540:x1875415589317888:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788536068.744265:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+36:14540:x1875415589317888:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 134us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536068.744273:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1788536068.747396:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536068.747589:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589318016 00000100:00100000:0.0:1788536068.747599:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589318016 00000100:00100000:0.0:1788536068.747675:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:0.0:1788536068.747685:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+36:14540:x1875415589318016:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788536068.829816:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:0.0:1788536068.829844:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788536068.830276:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9bf134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607122048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788536068.830346:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536068.830697:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+31:14540:x1875415589318016:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 83010us (83308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536068.830708:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000001:00080000:0.0:1788536068.830852:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788536068.831337:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607122048 00000100:00100000:1.0:1788536068.831345:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607122048 00000100:00100000:1.0:1788536068.831403:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788536068.831412:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875415607122048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788536068.831588:0:15003:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788536068.831592:0:15003:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788536068.831594:0:15003:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788536068.831596:0:15003:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788536068 -> 1788536068 00002000:00010000:1.0:1788536068.831599:0:15003:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788536068.840432:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875415607122048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 9011us (10075us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788536068.840457:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:3.0:1788536068.841077:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a9bf134380/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788536068.841086:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9bf134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875415607122048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788536068.842093:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536068.842229:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589318144 00000100:00100000:3.0:1788536068.842238:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589318144 00000100:00100000:3.0:1788536068.842326:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788536068.842337:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+7:2358:x1875415589318144:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788536068.842478:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+7:2358:x1875415589318144:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 143us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536068.842486:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:0.0:1788536068.847156:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536068.847264:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589318400 00000100:00100000:1.0:1788536068.847274:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589318400 00000100:00100000:1.0:1788536068.847370:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1788536068.847513:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+13:14540:x1875415589318400:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788536068.847575:0:14320:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788536068.847603:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a400/0x74f51638375d505b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ba7 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.850520:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a997503f00) 00010000:00010000:1.0:1788536068.850527:0:14320:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788536068.850702:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d5069 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.850719:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d5069 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.850732:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d5069 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788536068.850950:0:14320:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000008f2a308 reply state 000000003cb0dd5d transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d5069 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536068.850961:0:14320:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788536068.851093:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+14:14540:x1875415589318400:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 3581us (3943us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788536068.851104:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00010000:00010000:3.0:1788536068.860003:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d5069 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.860033:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d5069 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.860042:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d5069 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.860048:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:3.0:1788536068.860053:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d5069 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.860061:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d5069 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.860079:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a997503f00) 00010000:00010000:3.0:1788536068.860083:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788536068.860088:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d5069 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.860095:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f000/0x74f51638375d5069 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536068.862455:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536068.863077:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589318528 00000100:00100000:1.0:1788536068.863101:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589318528 00000100:00100000:1.0:1788536068.863170:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788536068.863190:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+7:14540:x1875415589318528:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788536068.863206:0:15004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536068.863223:0:15004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d5070 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515bb5 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.863252:0:15004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000671678c3/0x74f51638375d5062 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bae expref: 8 pid: 15005 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.863261:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536068.863266:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536068.863272:0:15004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d5070 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bb5 expref: 8 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.863305:0:15004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000671678c3/0x74f51638375d5062 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bae expref: 8 pid: 15005 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.863321:0:15004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000671678c3/0x74f51638375d5062 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bae expref: 8 pid: 15005 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536068.863335:0:15004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0814700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15004:1875415607122176:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788536068.863434:0:15004:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9860c0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788536068.867449:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536068.867582:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589318656 00000100:00100000:2.0:1788536068.867590:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589318656 00010000:00010000:2.0:1788536068.867636:0:14305:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000671678c3/0x74f51638375d5062 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bae expref: 9 pid: 15005 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536068.867677:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788536068.867686:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+9:2355:x1875415589318656:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788536068.867716:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788536068.867739:0:14305:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000671678c3/0x74f51638375d5062 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bae expref: 9 pid: 15005 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.867754:0:14305:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000671678c3/0x74f51638375d5062 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bae expref: 9 pid: 15005 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.867779:0:14305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536068.867783:0:14305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536068.867790:0:14305:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d5070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bb5 expref: 9 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.867799:0:14305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d5070 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bb5 expref: 9 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.867845:0:14305:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d5070 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bb5 expref: 9 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536068.867871:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d06680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14305:1875415607122304:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788536068.867963:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987964840 going to sleep for 11 seconds 00010000:00010000:1.0:1788536068.869200:0:15004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000671678c3/0x74f51638375d5062 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bae expref: 9 pid: 15005 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536068.869239:0:15004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0814700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15004:1875415607122176:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788536068.869266:0:15004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d5070 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bb5 expref: 8 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.869282:0:15004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b6d0a200, rc 0) 00000100:00100000:1.0:1788536068.869332:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+8:14540:x1875415589318528:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 6144us (6885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536068.869339:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1788536068.883511:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d06680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14305:1875415607122304:192.168.203.12@tcp:105: 00010000:00010000:2.0:1788536068.883558:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788536068.883620:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+7:2355:x1875415589318656:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 15934us (16186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536068.884361:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788536068.886499:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536068.886927:0:16189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589318784 00000100:00100000:3.0:1788536068.886937:0:16189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589318784 00000100:00100000:3.0:1788536068.886996:0:16189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788536068.887006:0:16189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+7:2356:x1875415589318784:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788536068.887226:0:16189:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788536068.887231:0:16189:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788536068 00002000:00010000:3.0:1788536068.887233:0:16189:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788536066 00002000:00010000:3.0:1788536068.887236:0:16189:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788536068 -> 1788536068 00002000:00010000:3.0:1788536068.887238:0:16189:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788536068.887295:0:16189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+8:2356:x1875415589318784:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 290us (804us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788536068.887303:0:16189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788536068.890947:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536068.891254:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589318912 00000100:00100000:2.0:1788536068.891264:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589318912 00000100:00100000:2.0:1788536068.891323:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788536068.891333:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+8:2357:x1875415589318912:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788536068.891375:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.891395:0:15003:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d5070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bb5 expref: 8 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.891403:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788536068.891407:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788536068.891412:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.891449:0:15003:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d5070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bb5 expref: 8 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.891463:0:15003:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d5070 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bb5 expref: 8 pid: 15004 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536068.891478:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15003:1875415607122432:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788536068.891566:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987964840 going to sleep for 11 seconds 00000100:00100000:1.0:1788536068.895279:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536068.895389:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15003:1875415607122432:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788536068.895415:0:15003:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536068.896346:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589319040 00000100:00100000:3.0:1788536068.896357:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589319040 00010000:00010000:3.0:1788536068.896398:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d5070 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bb5 expref: 9 pid: 15004 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536068.896443:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:3.0:1788536068.896454:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+9:2356:x1875415589319040:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788536068.896468:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536068.896489:0:14307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d5070 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bb5 expref: 9 pid: 15004 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.896502:0:14307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d5070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bb5 expref: 9 pid: 15004 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.896526:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4ce22ec/0x74f51638375d5070 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bb5 expref: 9 pid: 15004 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.896567:0:14307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788536068.896571:0:14307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788536068.896577:0:14307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.896587:0:14307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.896687:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536068.896847:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+8:2356:x1875415589319040:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 394us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536068.896856:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00010000:00010000:1.0:1788536068.896993:0:15003:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.897004:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.897037:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.897046:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.897054:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.897073:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747e800 already unused, calling callback (ffffffffc1455530) 00010000:00010000:1.0:1788536068.897078:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.897086:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.897098:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.897105:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058d59623/0x74f51638375d5077 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536068.897152:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+7:2357:x1875415589318912:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 5820us (6216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536068.897160:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788536068.901376:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536068.901439:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589319296 00000100:00100000:3.0:1788536068.901448:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589319296 00000100:00100000:3.0:1788536068.901500:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1788536068.901509:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b8d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+13:14540:x1875415589319296:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788536068.901593:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c000/0x74f51638375d507e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.901620:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c000/0x74f51638375d507e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.901634:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c000/0x74f51638375d507e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.901874:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.902182:0:15727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d504d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ba0 expref: 14 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.902192:0:15727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.903078:0:15727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d504d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ba0 expref: 14 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.903096:0:15727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d504d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ba0 expref: 14 pid: 15727 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536068.903111:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15727:1875415607122560:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788536068.903218:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a987964840 going to sleep for 11 seconds 00000100:00100000:0.0:1788536068.911152:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536068.911263:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15727:1875415607122560:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788536068.911287:0:15727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536068.911384:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589319424 00000100:00100000:3.0:1788536068.911392:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589319424 00010000:00010000:3.0:1788536068.911427:0:14305:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d504d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ba0 expref: 15 pid: 15727 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536068.911465:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788536068.911475:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+15:2356:x1875415589319424:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788536068.911488:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536068.911495:0:14305:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d504d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ba0 expref: 15 pid: 15727 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.911509:0:14305:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d504d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ba0 expref: 15 pid: 15727 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.911531:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d504d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515ba0 expref: 15 pid: 15727 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.911557:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a997503f00) 00010000:00010000:3.0:1788536068.911561:0:14305:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.911588:0:14305:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.911596:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.912119:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536068.912171:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+14:2356:x1875415589319424:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 695us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536068.912180:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00010000:00010000:0.0:1788536068.912305:0:15727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536068.912314:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788536068.912490:0:15727:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788536068.912725:0:15727:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1788536068.912776:0:15727:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1788536068.914130:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9c0b3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15727:1875415607122688:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788536068.914502:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536068.914534:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a9ba21c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788536068.915366:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607122688 00000100:00100000:3.0:1788536068.915376:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607122688 00000100:00100000:3.0:1788536068.915458:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788536068.915467:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15727:x1875415607122688:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788536068.915575:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15727:x1875415607122688:12345-0@lo:1000:mdt00_003.0 Request processed in 109us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536068.915582:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788536068.915663:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9c0b3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15727:1875415607122688:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788536068.916393:0:15727:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1788536068.916469:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15727:1875415607122816:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788536068.916510:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536068.917813:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a984dd09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788536068.918111:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607122816 00000100:00100000:0.0:1788536068.918119:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607122816 00000100:00100000:0.0:1788536068.918166:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788536068.918174:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:15727:x1875415607122816:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788536068.918392:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:15727:x1875415607122816:12345-0@lo:1000:mdt00_003.0 Request processed in 218us (1880us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788536068.918400:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788536068.918481:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b8d05180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15727:1875415607122816:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788536068.918516:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.918527:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.918554:0:15727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.918560:0:15727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216ca00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536068.918566:0:15727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.918580:0:15727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.918594:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a997503f00) 00010000:00010000:2.0:1788536068.918597:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788536068.918601:0:15727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.918608:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216ca00/0x74f51638375d5085 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.919124:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fdd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.919132:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fdd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.919139:0:15727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fdd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.919144:0:15727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a98ab4b600 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536068.919147:0:15727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fdd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.919165:0:15727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fdd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.919175:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a983911c00) 00010000:00010000:2.0:1788536068.919178:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788536068.919185:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fe4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b84 expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.919196:0:15727:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fe4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b84 expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.919206:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fe4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b84 expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.919238:0:15727:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ee00/0x74f51638375d4fe4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515b84 expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536068.919251:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b6ac1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15727:1875415607122944:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788536068.919319:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a984dd09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788536068.924557:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536068.924803:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b6ac1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15727:1875415607122944:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788536068.924839:0:15727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fdd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.924851:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4b600/0x74f51638375d4fdd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.924905:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d508c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.924936:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d508c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.924947:0:15727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d508c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.924958:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d508c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.924965:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d508c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.924972:0:15727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d508c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.924978:0:15727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b6d0ba00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788536068.924982:0:15727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d508c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.924989:0:15727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d508c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.925000:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a983911c00) 00010000:00010000:1.0:1788536068.925003:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788536068.925006:0:15727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d508c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.925019:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b6d0ba00/0x74f51638375d508c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.925029:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c000/0x74f51638375d507e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.925040:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c000/0x74f51638375d507e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.925046:0:15727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c000/0x74f51638375d507e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.925051:0:15727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216c000 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:1.0:1788536068.925054:0:15727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c000/0x74f51638375d507e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.925060:0:15727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c000/0x74f51638375d507e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.925068:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a983911c00) 00010000:00010000:1.0:1788536068.925070:0:15727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788536068.925073:0:15727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c000/0x74f51638375d507e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536068.925078:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216c000/0x74f51638375d507e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536068.925277:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b8d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+17:14540:x1875415589319296:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 23768us (23909us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788536068.925288:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000020:00080000:1.0:1788536068.925294:0:15727:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788536068.926606:0:14353:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788536068.926622:0:14353:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788536068.926655:0:14353:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788536068.926662:0:14353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788536068.928325:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589319552 00000100:00100000:3.0:1788536068.928338:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589319552 00000100:00100000:3.0:1788536068.928455:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788536068.928464:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+17:14539:x1875415589319552:12345-192.168.203.12@tcp:49:bash.0 00000100:00100000:3.0:1788536068.928604:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+17:14539:x1875415589319552:12345-192.168.203.12@tcp:49:bash.0 Request processed in 140us (4064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536068.928611:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788536068.928932:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536068.931266:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589319808 00000100:00100000:3.0:1788536068.931281:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589319808 00000100:00100000:3.0:1788536068.931404:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1788536068.931429:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+17:14540:x1875415589319808:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788536068.932305:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536068.932374:0:16189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589319936 00000100:00100000:2.0:1788536068.932381:0:16189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589319936 00000100:00100000:2.0:1788536068.932424:0:16189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788536068.932432:0:16189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+7:14539:x1875415589319936:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788536068.932444:0:16189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536068.932463:0:16189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9a3636c/0x74f51638375d5093 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515bbc expref: -99 pid: 16189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788536068.932500:0:16189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9ae504, atime: 0x6a9ae502, ctime: 0x6a9ae504, blocks: 0x1 00010000:00010000:2.0:1788536068.932516:0:16189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788536068.932521:0:16189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536068.932530:0:16189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9a3636c/0x74f51638375d5093 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bbc expref: 8 pid: 16189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.932554:0:16189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9a3636c/0x74f51638375d5093 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bbc expref: 8 pid: 16189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.932566:0:16189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a9b747f000, rc 0) 00000100:00100000:2.0:1788536068.932610:0:16189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+8:14539:x1875415589319936:12345-192.168.203.12@tcp:101:bash.0 Request processed in 179us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536068.932617:0:16189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788536068.936101:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788536068.936228:0:14324:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1788536068.936237:0:14324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1788536068.936790:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589320192 00000100:00100000:2.0:1788536068.936799:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589320192 00000100:00100000:0.0:1788536068.937177:0:16543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:0.0:1788536068.937192:0:16543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+19:14539:x1875415589320192:12345-192.168.203.12@tcp:35:bash.0 00000001:00080000:0.0:1788536068.937429:0:16543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000001:00080000:0.0:1788536068.937535:0:16543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000004:00080000:3.0:1788536068.937942:0:14323:0:(mdd_object.c:4338:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788536068.938069:0:14323:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1788536068.938116:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d509a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.938132:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d509a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.938143:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d509a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.938152:0:14323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d509a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.938160:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d509a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.938166:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d509a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536068.938186:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788536068.938272:0:14308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536068.938279:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d509a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.938286:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9c216d000 already unused, calling callback (ffffffffc1455530) 00010000:00010000:2.0:1788536068.938291:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d509a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.938300:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d509a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.938323:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a997503f00) 00010000:00010000:2.0:1788536068.938326:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788536068.938331:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d509a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.938337:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9c216d000/0x74f51638375d509a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536068.938349:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536068.938350:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536068.938352:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536068.938425:0:16543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+23:14539:x1875415589320192:12345-192.168.203.12@tcp:35:bash.0 Request processed in 1236us (2328us total) trans 8589934632 rc 0/0 00000100:00100000:0.0:1788536068.938434:0:16543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000020:00080000:0.0:1788536068.938439:0:16543:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788536068.938648:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+22:14540:x1875415589319808:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 7220us (9715us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1788536068.938656:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000020:00080000:3.0:1788536068.938660:0:14323:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788536068.986407:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536068.986494:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536068.986528:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536068.986586:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536068.986602:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589320576 00000100:00100000:3.0:1788536068.986613:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589320576 00000100:00100000:1.0:1788536068.986627:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536068.986652:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589320832 00000100:00100000:1.0:1788536068.986657:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589320832 00000100:00100000:3.0:1788536068.986687:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788536068.986699:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+6:2357:x1875415589320576:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788536068.986786:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:801f3f5f-e678-4c00-91a4-f7506520d14a+6:2357:x1875415589320576:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536068.986794:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00080000:3.0:1788536068.986817:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788536068.986830:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589320448 00000100:00080000:3.0:1788536068.986835:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788536068.986836:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589320448 00000100:00100000:1.0:1788536068.986868:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589320704 00000100:00100000:1.0:1788536068.986872:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589320704 00000100:00100000:1.0:1788536068.986923:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788536068.986932:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+5:2357:x1875415589320832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788536068.987003:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788536068.987019:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+5:2357:x1875415589320448:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788536068.987062:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+5:2357:x1875415589320832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 131us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536068.987070:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788536068.987088:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788536068.987096:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+5:2357:x1875415589320704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:0.0:1788536068.987115:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788536068.987119:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788536068.987860:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589320320 00000100:00100000:2.0:1788536068.987870:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589320320 00000100:00100000:2.0:1788536068.987932:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:2.0:1788536068.987941:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:2357:x1875415589320320:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788536068.990639:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ebbde98-87ac-49fa-9722-b860a25414cf+5:2357:x1875415589320448:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3617us (4042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536068.990652:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788536068.995884:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:801f3f5f-e678-4c00-91a4-f7506520d14a+5:2357:x1875415589320704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 8555us (9022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536068.995923:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1788536069.000297:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2232579b-d1e7-484c-9edd-a2aa5d8e2a6c+13:2357:x1875415589320320:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 12345us (13898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536069.000313:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:3.0:1788536069.084764:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536069.084929:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589321088 00000100:00100000:0.0:1788536069.084939:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589321088 00000100:00100000:0.0:1788536069.085007:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1788536069.085028:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+22:14551:x1875415589321088:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788536069.085057:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536069.085078:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a000/0x74f51638375d50a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d82f74f97515bc3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788536069.085188:0:14321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788536069.085311:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a000/0x74f51638375d50a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bc3 expref: 24 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536069.085326:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a990510800) 00010000:00010000:0.0:1788536069.085329:0:14321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788536069.085334:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a98ab4a000/0x74f51638375d50a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x8d82f74f97515bc3 expref: 24 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536069.085348:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a98ab4a000, rc 0) 00000100:00100000:0.0:1788536069.085605:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+23:14551:x1875415589321088:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 588us (849us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1788536069.085614:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1788536069.097592:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536069.097695:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589321216 00000100:00100000:3.0:1788536069.097705:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589321216 00000100:00100000:2.0:1788536069.097795:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:2.0:1788536069.097809:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9c0816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+23:14551:x1875415589321216:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1788536069.097920:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d50af lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.097937:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d50af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.097948:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d50af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.097977:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d50b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.097984:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d50b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.097991:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d50b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098202:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d50bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098210:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d50bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098217:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d50bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788536069.098249:0:14320:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d50bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098260:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d50af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098411:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d50af lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098418:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d50af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098425:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747f800 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536069.098429:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d50af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098442:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d50af lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098453:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a997503200) 00010000:00010000:2.0:1788536069.098456:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536069.098460:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d50af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098475:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747f800/0x74f51638375d50af lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098487:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d50b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098493:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d50b6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098499:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d50b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098504:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747ea00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536069.098507:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d50b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098512:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d50b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098518:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff97a990510a00) 00010000:00010000:2.0:1788536069.098520:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536069.098522:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d50b6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098536:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747ea00/0x74f51638375d50b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098559:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d50bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098565:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d50bd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098571:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d50bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098575:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a9b747fc00 already unused, calling callback (ffffffffc1e9a4f0) 00010000:00010000:2.0:1788536069.098578:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d50bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098584:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d50bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098591:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a983911c00) 00010000:00010000:2.0:1788536069.098593:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536069.098596:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d50bd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536069.098602:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a9b747fc00/0x74f51638375d50bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536069.098673:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9c0816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+23:14551:x1875415589321216:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 867us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536069.098680:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:2.0:1788536069.105595:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788536069.105768:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589321472 00000100:00100000:0.0:1788536069.105779:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589321472 00000100:00100000:0.0:1788536069.105854:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788536069.105865:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+23:14551:x1875415589321472:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788536069.106123:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ebbde98-87ac-49fa-9722-b860a25414cf+24:14551:x1875415589321472:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 259us (537us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1788536069.106130:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00010000:00010000:3.0:1788536069.390448:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788536069.521567:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1788536069.521599:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:3.0:1788536069.521612:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00010000:00010000:1.0:1788536070.415718:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788536070.857015:0:16581:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1788536071.437413:0:14309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536072.463168:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607123072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788536072.463238:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788536072.463320:0:14308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536072.463330:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607123072 00000100:00100000:0.0:1788536072.463337:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607123072 00000100:00100000:0.0:1788536072.463396:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788536072.463406:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607123072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788536072.463439:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788536072.463481:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875415607123072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536072.463488:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788536072.463507:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788536072.463555:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b7417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875415607123072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788536072.463883:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607123328:0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.463936:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536072.463964:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788536072.463971:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b91c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49edad1-b206-4ca7-85f1-c4b27706521e:3311:1875415607123200:0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.464012:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536072.464035:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607123712:0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.464071:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536072.464100:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607123328 00000100:00100000:2.0:1788536072.464105:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607123328 00000100:00100000:2.0:1788536072.464139:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788536072.464145:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607123328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.464181:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607123328:12345-0@lo:400:kworker.0 Request processed in 36us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536072.464188:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788536072.464205:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607123200 00000100:00100000:2.0:1788536072.464208:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607123200 00000100:00100000:2.0:1788536072.464228:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788536072.464234:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9ba236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+19:3311:x1875415607123200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.464279:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9ba236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c49edad1-b206-4ca7-85f1-c4b27706521e+19:3311:x1875415607123200:12345-0@lo:400:kworker.0 Request processed in 45us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536072.464285:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788536072.464312:0:15727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607123712 00000100:00100000:2.0:1788536072.464315:0:15727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607123712 00000100:00100000:2.0:1788536072.464339:0:15727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788536072.464346:0:15727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b7409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607123712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.464373:0:15727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b7409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875415607123712:12345-0@lo:400:kworker.0 Request processed in 28us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536072.464387:0:15727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788536072.464416:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c49edad1-b206-4ca7-85f1-c4b27706521e:3311:1875415607123200:0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.464426:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875415607123712:0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.464433:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788536072.464437:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97a9bf134380, transno 8589934595 00000004:00080000:2.0:1788536072.464447:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788536072.464462:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b91c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607123328:0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.464758:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607123456:0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.464784:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536072.464805:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788536072.464810:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607123584:0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.464831:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536072.464854:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607123456 00000100:00100000:2.0:1788536072.464858:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607123456 00000100:00100000:2.0:1788536072.464879:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607123584 00000100:00100000:2.0:1788536072.464882:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607123584 00000100:00100000:2.0:1788536072.464926:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788536072.464932:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b740bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607123456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.464967:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b740bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875415607123456:12345-0@lo:400:kworker.0 Request processed in 35us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536072.464973:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788536072.464984:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788536072.464989:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9bf134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607123584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.465014:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9bf134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875415607123584:12345-0@lo:400:kworker.0 Request processed in 25us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536072.465028:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788536072.465059:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875415607123584:0@lo:400:kworker.0 00000100:00100000:2.0:1788536072.465068:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875415607123456:0@lo:400:kworker.0 00000100:00080000:2.0:1788536072.465083:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788536072.465087:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788536072.474468:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a9b740b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607123840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788536072.474564:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536072.474739:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415607123840 00000100:00100000:0.0:1788536072.474747:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415607123840 00000100:00100000:0.0:1788536072.474806:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788536072.474816:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a9b740b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607123840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788536072.474861:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788536072.474933:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a9b740b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875415607123840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536072.474941:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788536072.474986:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a9b740b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875415607123840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788536072.566111:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788536072.566152:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788536072.566227:0:16189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589321728 00000100:00100000:1.0:1788536072.566238:0:16189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589321728 00000100:00100000:1.0:1788536072.566313:0:16189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788536072.566324:0:16189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+6:2358:x1875415589321728:12345-192.168.203.12@tcp:16:kworker.0 00000100:00100000:1.0:1788536072.566443:0:16189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ebbde98-87ac-49fa-9722-b860a25414cf+6:2358:x1875415589321728:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 120us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536072.566464:0:16189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00080000:3.0:1788536072.567053:0:14316:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788536072.567157:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415589321600 00000100:00100000:0.0:1788536072.567163:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415589321600 00002000:00100000:0.0:1788536072.567198:0:15008:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff97a986f14000 x1875415589321600/t0(0) o4->4ebbde98-87ac-49fa-9722-b860a25414cf@192.168.203.12@tcp:728/0 lens 504/0 e 0 to 0 dl 1788536083 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788536072.567209:0:15008:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a986f14000 with x1875415589321600 ext(0->8) 00002000:00010000:0.0:1788536072.567214:0:15008:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a986f14000 00000100:00100000:0.0:1788536072.567242:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788536072.567262:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97a986f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+6:2358:x1875415589321600:12345-192.168.203.12@tcp:4:bash.0 00000100:00100000:0.0:1788536072.569043:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97a986f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ebbde98-87ac-49fa-9722-b860a25414cf+8:2358:x1875415589321600:12345-192.168.203.12@tcp:4:bash.0 Request processed in 1771us (2928us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788536072.569056:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00100000:0.0:1788536072.569068:0:15008:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff97a986f14000 x1875415589321600/t8589934598(0) o4->4ebbde98-87ac-49fa-9722-b860a25414cf@192.168.203.12@tcp:728/0 lens 504/448 e 0 to 0 dl 1788536083 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788536072.569078:0:15008:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a986f14000 with x1875415589321600 ext(0->8) 00002000:00010000:0.0:1788536072.569083:0:15008:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97a986f14000 Debug log: 29171 lines, 29171 kept, 0 dropped, 0 bad.